-- Logs begin at Fri 2022-08-19 20:13:28 UTC, end at Fri 2022-08-19 21:33:38 UTC. -- Aug 19 20:59:35.327514 dv-cinder-852209-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 19 20:59:35.336860 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 19 20:59:35.339470 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 19 20:59:35 2022] *** Aug 19 20:59:35.339470 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 19 20:59:35.339470 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 19 20:59:35.339470 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: nodename: dv-cinder-852209-6-iscsi Aug 19 20:59:35.339470 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: machine: x86_64 Aug 19 20:59:35.339470 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: clock source: unix Aug 19 20:59:35.339470 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: pcre jit disabled Aug 19 20:59:35.339470 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: detected number of CPU cores: 4 Aug 19 20:59:35.339470 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: current working directory: / Aug 19 20:59:35.339470 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: detected binary path: /usr/bin/uwsgi-core Aug 19 20:59:35.339470 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: your processes number limit is 47680 Aug 19 20:59:35.339470 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: your memory page size is 4096 bytes Aug 19 20:59:35.339470 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: detected max file descriptor number: 2048 Aug 19 20:59:35.339470 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: lock engine: pthread robust mutexes Aug 19 20:59:35.343527 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: thunder lock: enabled Aug 19 20:59:35.343734 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 19 20:59:35.343820 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 19 20:59:35.384952 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: Python main interpreter initialized at 0x55659b4df9c0 Aug 19 20:59:35.384952 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: python threads support enabled Aug 19 20:59:35.384952 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: your server socket listen backlog is limited to 100 connections Aug 19 20:59:35.384952 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: your mercy for graceful operations on workers is 90 seconds Aug 19 20:59:35.385448 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: mapped 403077 bytes (393 KB) for 2 cores Aug 19 20:59:35.385448 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: *** Operational MODE: preforking *** Aug 19 20:59:35.385701 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: *** uWSGI is running in multiple interpreter mode *** Aug 19 20:59:35.385701 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: spawned uWSGI master process (pid: 105790) Aug 19 20:59:35.385983 dv-cinder-852209-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 19 20:59:35.388515 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: spawned uWSGI worker 1 (pid: 105791, cores: 1) Aug 19 20:59:35.388515 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: spawned uWSGI worker 2 (pid: 105792, cores: 1) Aug 19 20:59:35.388515 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 19 20:59:36.074137 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 19 20:59:36.074909 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 19 20:59:37.206697 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 20:59:37.206697 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: from cryptography.utils import int_from_bytes Aug 19 20:59:37.207617 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 20:59:37.207617 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: from cryptography.utils import int_from_bytes Aug 19 20:59:37.207617 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 20:59:37.207617 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: from cryptography.utils import int_from_bytes Aug 19 20:59:37.208493 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 20:59:37.208493 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: from cryptography.utils import int_from_bytes Aug 19 20:59:39.790118 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 20:59:39.790683 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 20:59:39.790905 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 20:59:39.791256 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 20:59:39.791514 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 20:59:39.791903 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.792230 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.792555 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.792875 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.793204 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.793298 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 20:59:39.793641 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.793729 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 20:59:39.793845 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.794095 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 20:59:39.794202 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.794456 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 20:59:39.794540 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.794713 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 20:59:39.794823 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.795038 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.795145 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.795366 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-6-iscsi {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.795465 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.795688 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.795795 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.795999 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.796175 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.796310 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.796397 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.796626 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.796711 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.796959 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.797142 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.797253 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.797339 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.797550 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.797638 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.797865 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.798080 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.798224 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.799245 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-6-iscsi {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.799346 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.799438 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.799509 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.799582 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.799648 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.799711 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.799780 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.799855 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.799928 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.800000 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.800071 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.800327 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.800501 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.800618 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.800704 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.800963 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.801122 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.801277 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.801436 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.801677 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-6-iscsi {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.801791 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.802021 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.802166 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.802335 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.802422 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.802652 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.802781 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.802988 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.803084 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.803307 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.803399 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.803617 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.803711 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.803943 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.804036 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.804944 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.805174 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.805296 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.805596 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.805923 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-6-iscsi {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.806025 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.806264 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.806430 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.806591 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.806758 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.806896 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.807109 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.807204 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.807507 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.807654 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.807829 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.807976 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.808136 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.808292 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.808445 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.808701 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.808851 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.809012 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.809300 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.809387 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.809626 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.809711 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.809981 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.810106 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.810240 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.810483 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.810577 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.810801 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.810895 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.811123 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.811219 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.811433 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.811545 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.811743 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.811875 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.812054 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.812264 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.812356 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.812595 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.812681 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.812909 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.813003 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.813221 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.813321 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.813510 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.813605 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.813812 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.813918 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.814147 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.814233 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.814484 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.814568 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.814793 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.814885 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.815116 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.815231 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.815367 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.815516 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.815770 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.815856 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.816087 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.816172 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.816420 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.816515 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.816738 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.816982 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.817075 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.817350 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.817442 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.817672 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.817784 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.818009 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.818094 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.818321 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.818444 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.818629 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.818722 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.818948 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.819040 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.819287 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.819509 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.819595 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.819672 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.820335 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.820525 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.820643 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.820841 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.820951 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.821269 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.821352 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.821574 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.821706 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.821904 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.821994 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.822211 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.822304 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.822510 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.822618 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.822817 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.822939 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.823123 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.823251 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.823427 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.823573 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.823733 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.823883 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.824040 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.824191 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.824344 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.824510 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.824635 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.824795 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.824939 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.825115 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.825244 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.825452 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.825562 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.825779 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.825905 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.826036 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.826219 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.826341 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.826523 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.826648 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.826827 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.826966 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.827133 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.827273 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.827452 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.827580 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.827756 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.827887 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.828060 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.828188 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.828379 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.828496 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.828685 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.828802 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.828988 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.829118 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.829306 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.829392 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.829612 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.829707 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.829943 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.830031 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.830262 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.830350 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.830561 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.830649 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.830867 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.830954 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.831181 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.831301 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.831485 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.831607 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.831791 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.831879 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.832095 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.832178 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.832394 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.832486 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.832695 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.832793 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.832994 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.833078 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.833294 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.833381 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.833595 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.833681 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.833921 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.834021 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.834237 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.834321 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.834543 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.834638 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.834849 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.834933 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.835152 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.835244 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.835511 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.836184 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.836334 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.836554 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.836673 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.836864 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.837007 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.837176 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.837350 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.837496 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.837666 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.837830 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.838094 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.838195 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.838427 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.838512 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.838730 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.838824 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.839035 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.839128 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.839340 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.839428 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.839643 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.839737 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.839947 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.840040 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.840246 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.840331 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.840561 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.840652 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.840880 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.840964 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.841191 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.841278 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.841500 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.841598 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.841829 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.841961 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.842158 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.842272 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 20:59:39.842475 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.842574 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.842786 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.842876 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.843103 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.843211 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.843431 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.843520 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.843752 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.843840 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.844064 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.844180 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.844405 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.844495 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.844747 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.844837 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.845060 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.845156 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.845384 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.845471 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.845701 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.845822 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.846038 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.846217 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.846350 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.846441 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.846651 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.846751 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.846965 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.847073 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.847292 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.847389 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.847604 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.847739 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.847918 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.848020 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.848235 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.848398 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.848533 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.848671 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.848842 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.848959 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.849143 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.849241 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.849455 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.849553 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.849823 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.849925 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.850117 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.850213 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.850439 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.850550 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.850747 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.850834 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.851108 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.851194 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.851427 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.851527 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.851743 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.851871 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.852055 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.852162 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.852361 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.852483 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.852667 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.852812 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.852969 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.853150 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.853279 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.853468 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.853582 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.853816 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.853928 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.854135 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.854256 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.854453 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.854564 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.854773 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.854899 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.855082 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.855208 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.855396 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.855499 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.855733 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.855829 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.856050 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.856145 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.856375 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.856591 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.856732 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.856869 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.857000 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.857104 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.857263 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.857349 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.857586 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.857673 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.857924 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.858025 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.858231 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.858313 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.858537 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.858622 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.858843 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.858988 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.859145 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.859230 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.859449 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.859540 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.859759 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.859836 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.860070 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.860162 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.860375 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.860458 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.860687 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.860773 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.860999 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.861072 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.861312 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.861396 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.861619 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.861704 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.861973 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.862061 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.862280 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.862366 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.862593 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.862680 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.862905 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.862991 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.863213 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.863308 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.863529 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.863614 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.863835 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.863922 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.864137 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.864230 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.864438 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.864529 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.864743 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.864829 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.865044 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.865136 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.865348 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.865433 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.865652 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.865737 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.865983 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.866083 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.866292 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.866378 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.866595 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.866885 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.866991 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.867072 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.867233 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.867347 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.867658 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.867744 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.867968 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.868055 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.868273 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.868358 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.868578 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.868663 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.868911 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.868995 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.869221 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.869343 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.869542 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.869639 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.869907 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.870009 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.870231 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.870318 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.870535 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.870632 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.871104 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.871197 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.871409 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.871508 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.871717 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.871875 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.872026 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.872125 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.872328 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.872422 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.872635 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.872748 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.872936 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.873030 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.873238 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.873325 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.873555 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.873650 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.873885 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.873974 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.874193 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.874278 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.874496 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.874596 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.874800 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.874894 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.875105 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.875191 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.875423 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.875512 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.875760 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.875853 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.876094 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.876181 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.876410 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.876496 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.876729 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.876813 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.877039 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.877130 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.877351 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.877436 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.877659 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.877748 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.877993 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.878077 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.878304 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.878390 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.878614 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.878708 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.878931 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.879023 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.879239 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.879323 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.879555 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.879637 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.879863 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.879955 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.880186 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.880270 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.880493 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.880584 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.880808 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.880906 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.881110 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.881195 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.881422 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.881507 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.881750 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.881884 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.882103 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.882190 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.882956 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.883047 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.883270 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.883363 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.883581 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.883671 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.883899 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.883984 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.884212 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.884299 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.884524 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.884609 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.884836 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.884926 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.885155 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.885274 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.885469 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.885555 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.885821 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.885922 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.886122 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.886205 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.886429 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.886503 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.886771 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.886865 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.887044 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.887137 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.887349 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.887433 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.887654 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.887740 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.887958 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.888045 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.888269 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.888362 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.888589 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.888688 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.888897 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.888980 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.889210 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.889345 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.889533 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.889672 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.889854 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.889989 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.890160 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.890246 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.890470 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.890558 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.890776 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.890938 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.891078 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.891165 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.891385 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.891476 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.891687 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.891819 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.892001 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.892085 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.892314 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.892408 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.892613 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.892705 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.892926 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.893011 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.893237 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.893323 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.893542 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.893630 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.893868 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.893968 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.894184 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.894271 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.894491 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.894575 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.894803 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.894896 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.895113 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.895198 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.895422 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.895508 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.895722 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.895814 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.896028 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.896113 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.896335 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.896418 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.896645 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.896737 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.896951 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.897057 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.897254 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.897347 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.897557 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.897656 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.897930 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.898574 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.898835 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.898952 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.899189 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.899277 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.899577 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.899679 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.899905 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.900172 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.900280 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.900511 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.900597 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.900825 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.900909 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.901139 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.901234 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.901459 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.901544 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.901854 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.901950 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.902113 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.902215 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.902428 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.902514 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.902744 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.902875 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.903061 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.903157 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.903370 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.903457 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.903678 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.903764 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.903986 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.904071 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.904297 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.904382 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.904599 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.904683 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.904904 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.904998 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.905204 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.905297 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.905519 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.905679 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.905876 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.906123 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.906278 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.906458 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.906607 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.906775 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.906923 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.907171 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.907314 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.907457 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.907603 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.907742 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.907864 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.907965 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.908079 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.908269 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.908427 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.908584 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.908754 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.908911 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.909066 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.909204 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.909340 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.909485 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.909642 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.909837 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.909983 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.910110 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.910239 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.910432 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.910590 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.910746 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.910892 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.911035 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.911177 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.911352 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.911516 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.911676 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.911822 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.912025 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.912173 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.912319 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.912464 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.912620 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.912762 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.912904 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.913048 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.913205 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.913388 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.913691 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.914081 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.914081 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.914249 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.914332 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.914412 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.914587 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.914674 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.914899 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.914994 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.915211 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.915312 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.915515 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.915599 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.915825 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.915910 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.916129 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.916228 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.916450 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.916543 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.916758 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.916844 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.917068 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.917217 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.917369 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.917463 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.917677 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.917823 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.918012 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.918104 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.918316 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.918409 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.918625 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.918710 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.918927 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.919014 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.919241 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.919334 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.919602 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.919702 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.919845 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.919931 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.920146 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.920229 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.920456 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.920553 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.920762 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.920845 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.921065 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.921158 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.921367 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.921464 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.921682 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.921795 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.922040 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.922141 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.922313 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.922410 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.922620 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.922705 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.922920 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.923012 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.923221 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.923313 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.923529 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.923613 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.923837 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.923919 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.924141 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.924227 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.924443 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.924529 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.924742 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.924833 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.925046 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.925137 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.925348 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.925431 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.925717 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.925849 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.925980 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.926066 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.926287 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.926385 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.926590 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.926675 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.926891 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.926975 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.927195 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.927336 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.927496 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.927591 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.927804 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.927887 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.928089 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.928178 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.928446 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.928562 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.928702 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.928787 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.929002 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.929085 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.929388 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.929561 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.929800 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.929909 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.930124 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.930255 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.930435 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.930629 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.930748 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.930865 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.931056 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.931268 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.931404 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.931478 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.931663 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.931785 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.931973 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.932108 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.932278 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.932405 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.932583 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.932721 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.932886 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.933032 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.933191 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.933345 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.933496 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.933651 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.933847 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.933983 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.934163 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.934305 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.934469 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.934619 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.934777 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.934931 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.935083 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.935253 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.935428 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.935578 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.935731 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.935904 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.936093 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.936211 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.936401 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.936528 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.936717 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.936841 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.937038 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.937161 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.937352 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.937483 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.937664 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.937887 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.938006 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.938091 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.938314 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.938408 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.938628 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.938722 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.938940 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.939025 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.939250 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.939334 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.939554 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.939638 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.939856 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.939951 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.940161 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.940242 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.940468 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.940544 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.940776 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.940868 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.941088 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.941171 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.941393 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.941487 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.941705 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.941808 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.942037 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.942123 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.942346 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.942430 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.942648 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.942732 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.942956 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.943088 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.943266 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.943402 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.943578 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.943714 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.943890 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.944020 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.944201 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.944333 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.944512 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.944647 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.945379 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.945520 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.945695 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.945913 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.946034 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.946174 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.946346 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.946593 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.946679 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.946914 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.946999 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.947613 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.947812 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.947899 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.947977 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.948060 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.948138 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.948214 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.948303 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.948584 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.948803 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.948803 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.948956 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.949143 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.949235 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.949321 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.949433 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.949598 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.949747 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.949953 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.950087 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.950422 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.950525 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.950605 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.950671 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.950970 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.951319 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.951319 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.951509 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.951587 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.951663 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.951880 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.951966 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.952270 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.952356 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.952580 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.952677 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.952888 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.952973 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.953199 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.953283 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.953503 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.953596 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.953829 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.953910 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.954144 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.954241 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.954454 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.954550 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.954757 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.954840 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.955061 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.955147 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.955364 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.955459 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.955686 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.955770 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.955988 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.956071 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.956305 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.956397 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.956626 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.956735 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.956948 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.957034 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.957271 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.957395 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.957693 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.957803 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.958045 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.958143 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.958358 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.958443 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.958679 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.958772 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.958997 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.959082 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.959302 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.959402 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.959607 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.959693 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.959913 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.960012 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.960225 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.960367 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.960522 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.960654 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.961398 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.961540 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.961708 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.961843 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.962050 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.962169 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.962358 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.962530 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.962685 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.962799 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.963003 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.963098 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.963321 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.963466 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.963638 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.963738 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.963964 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.964057 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.964288 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.964365 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.964606 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.964711 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.964930 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.965019 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.965257 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.965345 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.965559 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.965655 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.965886 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.966037 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.966199 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.966351 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.966506 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.966657 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.966817 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.966971 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.967142 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.967277 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.967448 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.967623 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.967762 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.967928 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.968075 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.968251 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.968387 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.968580 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.968689 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.968906 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.968993 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.969216 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.969310 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.969548 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.969634 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.969898 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.969998 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.970226 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.970395 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.970548 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.970657 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.970862 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.970991 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.971165 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.971258 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.971648 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.971846 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.971929 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.972007 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.972099 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.972177 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.972365 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.972451 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.972666 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.972756 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.972975 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.973063 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.973276 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.973369 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.973579 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.973664 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.973909 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.974035 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.974228 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.974315 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.974531 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.974635 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.974853 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.974939 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.975163 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.975256 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.975466 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.975561 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.975772 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.975858 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.976653 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.976765 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.976965 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.977068 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.977270 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.977357 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.977606 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.977690 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.977942 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.978032 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.978269 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.978365 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.978577 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.978661 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.978886 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.978972 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.979190 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.979276 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.979494 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.979591 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.979795 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.979881 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.980106 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.980189 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.980411 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.980505 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.980719 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.980811 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.981028 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.981112 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.981333 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.981419 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.981642 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.981733 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.981976 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.982234 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.982320 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.982569 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.982682 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.982887 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.982973 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.983203 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.983287 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.983518 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.983605 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.983830 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.983913 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.984140 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.984224 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.984451 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.984536 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.984762 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.984846 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.985074 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.985233 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.985382 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.985468 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.985693 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.985795 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.986032 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.986130 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.986347 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.986433 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.986665 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.986740 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.986982 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.987144 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.987303 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.987543 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.987629 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.987875 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.987968 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.988190 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.988275 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.988502 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.988587 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.988815 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.988909 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.989129 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.989214 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.989441 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.989526 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.989755 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.989878 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.990091 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.990176 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.990400 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.990540 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.990710 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.990797 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.991020 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.991148 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.991335 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.991422 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.991670 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.991785 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.992540 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.992628 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.992859 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.992954 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.993186 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.993273 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.993519 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.993604 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.993868 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.993971 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.994188 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.994274 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.994504 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.994589 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.994822 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.994927 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.995142 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.995380 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.995472 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.995688 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.996041 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.996277 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.996363 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.996601 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.996684 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.996917 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.997011 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.997231 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.997316 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.997543 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.997627 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.997880 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.997984 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.998252 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.998383 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.998497 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.998583 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.998809 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.998904 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.999119 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.999205 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.999425 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.999515 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.999747 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:39.999832 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.000056 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.000140 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.000361 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.000454 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.000684 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.000900 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.000992 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.001219 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.001517 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.001604 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.001900 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.001988 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.002218 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.002304 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.002537 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.002642 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.002853 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.002939 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.003168 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.003253 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.003472 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.003574 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.003776 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.003861 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.004084 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.004168 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.004394 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.004498 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.004696 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.004781 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.005005 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.005096 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.005313 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.005407 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.005615 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.005699 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.005951 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.006036 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.006261 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.006354 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.006564 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.006795 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.006881 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.007149 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.007272 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.007497 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.007595 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.007825 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.008035 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.008123 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.008210 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.008423 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.008511 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.008736 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.008821 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.009042 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.009141 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.009348 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.009432 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.009652 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.009742 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.009989 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.010077 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.010297 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.010394 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.010598 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.010689 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.010901 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.010994 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.011202 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.011286 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.011510 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.011596 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.011815 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.011901 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.012122 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.012212 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.012424 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.012509 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.012746 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.012832 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.013049 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.013140 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.013361 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.013500 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.013652 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.013738 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.013990 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.014075 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.014295 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.014395 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.014670 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.014776 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.014903 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.015036 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.015207 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.015372 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.015520 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.015614 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.016920 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.017008 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.017101 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.017101 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.017263 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.017343 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.017420 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.017497 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.017583 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.017662 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.017746 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.017905 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.017988 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.018068 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.018202 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.018290 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.018368 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.018539 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.018627 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.018858 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.018952 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.019171 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.019264 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.019484 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.019621 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.019793 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.019886 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.020104 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.020188 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.020418 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.020518 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.020734 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.020828 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.021047 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.021290 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.021377 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.021623 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.021724 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.021974 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.022061 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.022305 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.022389 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.022620 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.022723 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.023455 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.023558 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.023769 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.023982 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.024079 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.024186 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.024394 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.024559 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.024708 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.024822 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.025053 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.025170 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.025341 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.025456 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.025653 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.025790 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.025988 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.026100 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.026297 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.026415 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.026607 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.026720 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.026915 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.027033 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.027226 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.027338 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.027536 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.027657 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.027842 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.027953 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.028149 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.028261 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.028459 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.028581 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.028770 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.028883 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.029087 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.029199 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.029429 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.029553 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.029750 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.030047 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.030127 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.030203 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.030398 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.030486 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.030715 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.030801 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.031026 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.031111 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.031336 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.031421 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.031649 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.031734 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.031962 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.032058 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.032276 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.032363 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.032604 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.032696 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.032912 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.033006 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.033214 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.033298 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.033522 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.033644 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.033865 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.033987 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.034178 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.034310 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.034482 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.034634 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.034787 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.034946 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.035098 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.035267 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.035403 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.035589 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.035710 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.035902 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.036014 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.036224 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.036309 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.036535 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.036629 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.036865 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.036950 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.037190 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.037274 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.037494 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.037589 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.037848 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.037938 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.038126 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.038212 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.038429 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.038563 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.039299 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.039388 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.039603 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.039736 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.039946 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.040040 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.040304 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.040397 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.040562 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.040648 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.040867 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.040961 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.041179 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.041265 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.041486 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.041570 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.041811 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.041900 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.042119 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.042205 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.042429 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.042514 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.042738 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.042825 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.043038 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.043124 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.043341 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.043435 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.043644 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.043777 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.043947 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.044035 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.044249 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.044344 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.044551 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.044644 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.044859 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.044945 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.045161 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.045325 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.045466 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.045553 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.045803 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.045892 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.046093 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.046191 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.046396 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.046489 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.046723 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.046808 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.047054 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.047139 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.047359 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.047443 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.047680 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.047764 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.047992 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.048085 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.048311 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.048395 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.048618 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.048701 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.048928 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.049013 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.049245 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.049328 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.049560 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.049653 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.049892 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.049992 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.050206 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.050290 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.050519 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.050614 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.050828 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.050919 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.051139 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.051276 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.051451 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.051546 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.051762 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.051884 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.052072 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.052159 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.052387 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.052472 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.052714 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.052800 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.053017 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.053102 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.053336 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.053421 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.053652 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.053738 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.054003 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.054091 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.054424 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.054526 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.054746 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.054832 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.055079 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.055174 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.055395 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.055481 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.055708 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.055802 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.056021 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.056119 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.056335 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.056423 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.056580 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 20:59:40.056673 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.056952 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.057266 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.057577 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.057921 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.058243 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.058570 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.058895 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.059210 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.059533 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.059859 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.060213 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.060530 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.060881 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.061210 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.061527 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.061871 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.062185 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 20:59:40.062437 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 20:59:40.213682 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO dbcounter [None req-7fb498e7-5870-477d-88ff-f312136f18fc None None] Registered counter for database nova_api Aug 19 20:59:40.220967 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO dbcounter [None req-85805b40-ba5f-4991-a817-e6dfc948ebd0 None None] Registered counter for database nova_api Aug 19 20:59:40.237924 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_db.sqlalchemy.engines [None req-7fb498e7-5870-477d-88ff-f312136f18fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 20:59:40.245046 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG dbcounter [-] [105792] Writer thread running {{(pid=105792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 20:59:40.247487 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG oslo_db.sqlalchemy.engines [None req-85805b40-ba5f-4991-a817-e6dfc948ebd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 20:59:40.254168 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writer thread running {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 20:59:40.303205 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.context [None req-7fb498e7-5870-477d-88ff-f312136f18fc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fc0b118c-f5c7-41ee-a2c7-c718014c8ac6(cell1) {{(pid=105792) load_cells /opt/stack/nova/nova/context.py:464}} Aug 19 20:59:40.307087 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-7fb498e7-5870-477d-88ff-f312136f18fc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 20:59:40.307575 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-7fb498e7-5870-477d-88ff-f312136f18fc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 20:59:40.309161 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-7fb498e7-5870-477d-88ff-f312136f18fc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 20:59:40.309956 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-7fb498e7-5870-477d-88ff-f312136f18fc None None] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 20:59:40.310409 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-7fb498e7-5870-477d-88ff-f312136f18fc None None] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 20:59:40.311308 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.context [None req-85805b40-ba5f-4991-a817-e6dfc948ebd0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fc0b118c-f5c7-41ee-a2c7-c718014c8ac6(cell1) {{(pid=105791) load_cells /opt/stack/nova/nova/context.py:464}} Aug 19 20:59:40.312438 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-7fb498e7-5870-477d-88ff-f312136f18fc None None] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 20:59:40.314496 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO dbcounter [None req-7fb498e7-5870-477d-88ff-f312136f18fc None None] Registered counter for database nova_cell0 Aug 19 20:59:40.315189 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-85805b40-ba5f-4991-a817-e6dfc948ebd0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 20:59:40.315672 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-85805b40-ba5f-4991-a817-e6dfc948ebd0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 20:59:40.317279 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-85805b40-ba5f-4991-a817-e6dfc948ebd0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 20:59:40.318067 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-85805b40-ba5f-4991-a817-e6dfc948ebd0 None None] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 20:59:40.318524 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-85805b40-ba5f-4991-a817-e6dfc948ebd0 None None] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 20:59:40.320296 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO dbcounter [None req-7fb498e7-5870-477d-88ff-f312136f18fc None None] Registered counter for database nova_cell1 Aug 19 20:59:40.320596 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG oslo_concurrency.lockutils [None req-85805b40-ba5f-4991-a817-e6dfc948ebd0 None None] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 20:59:40.322689 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO dbcounter [None req-85805b40-ba5f-4991-a817-e6dfc948ebd0 None None] Registered counter for database nova_cell0 Aug 19 20:59:40.328398 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_db.sqlalchemy.engines [None req-7fb498e7-5870-477d-88ff-f312136f18fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 20:59:40.328596 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO dbcounter [None req-85805b40-ba5f-4991-a817-e6dfc948ebd0 None None] Registered counter for database nova_cell1 Aug 19 20:59:40.330679 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_db.sqlalchemy.engines [None req-7fb498e7-5870-477d-88ff-f312136f18fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 20:59:40.334789 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG dbcounter [-] [105792] Writer thread running {{(pid=105792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 20:59:40.337052 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG oslo_db.sqlalchemy.engines [None req-85805b40-ba5f-4991-a817-e6dfc948ebd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 20:59:40.340802 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG oslo_db.sqlalchemy.engines [None req-85805b40-ba5f-4991-a817-e6dfc948ebd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 20:59:40.342923 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writer thread running {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 20:59:40.477235 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG dbcounter [-] [105792] Writer thread running {{(pid=105792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 20:59:40.487288 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writer thread running {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 20:59:40.488991 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO dbcounter [None req-7fb498e7-5870-477d-88ff-f312136f18fc None None] Registered counter for database nova_cell0 Aug 19 20:59:40.497055 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO dbcounter [None req-85805b40-ba5f-4991-a817-e6dfc948ebd0 None None] Registered counter for database nova_cell0 Aug 19 20:59:40.497365 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_db.sqlalchemy.engines [None req-7fb498e7-5870-477d-88ff-f312136f18fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 20:59:40.502440 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG dbcounter [-] [105792] Writer thread running {{(pid=105792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 20:59:40.506505 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG oslo_db.sqlalchemy.engines [None req-85805b40-ba5f-4991-a817-e6dfc948ebd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 20:59:40.512257 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writer thread running {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 20:59:40.854070 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: WARNING keystonemiddleware.auth_token [None req-7fb498e7-5870-477d-88ff-f312136f18fc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 20:59:40.855063 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: WARNING keystonemiddleware.auth_token [None req-85805b40-ba5f-4991-a817-e6dfc948ebd0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 20:59:40.861455 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: WARNING keystonemiddleware.auth_token [None req-7fb498e7-5870-477d-88ff-f312136f18fc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 20:59:40.862449 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: WARNING keystonemiddleware.auth_token [None req-85805b40-ba5f-4991-a817-e6dfc948ebd0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 20:59:41.211399 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: WARNING keystonemiddleware.auth_token [None req-85805b40-ba5f-4991-a817-e6dfc948ebd0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 20:59:41.211875 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: WARNING keystonemiddleware.auth_token [None req-7fb498e7-5870-477d-88ff-f312136f18fc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 20:59:41.217280 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: WARNING keystonemiddleware.auth_token [None req-85805b40-ba5f-4991-a817-e6dfc948ebd0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 20:59:41.217959 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: WARNING keystonemiddleware.auth_token [None req-7fb498e7-5870-477d-88ff-f312136f18fc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 20:59:41.222689 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55659b4df9c0 pid: 105791 (default app) Aug 19 20:59:41.223301 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55659b4df9c0 pid: 105792 (default app) Aug 19 20:59:41.224889 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-85805b40-ba5f-4991-a817-e6dfc948ebd0 None None] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 20:59:41.226678 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-85805b40-ba5f-4991-a817-e6dfc948ebd0 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001843 Aug 19 20:59:41.227188 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Fri Aug 19 20:59:41 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:01:06.313193 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-7fb498e7-5870-477d-88ff-f312136f18fc None None] Calling method '>' {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:01:06.315949 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-7fb498e7-5870-477d-88ff-f312136f18fc None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003627 Aug 19 21:01:06.316844 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 931 bytes} [Fri Aug 19 21:01:06 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:01:06.329561 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writing DB stats nova_api:SELECT=3 {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:06.330879 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writing DB stats nova_cell0:SELECT=3 {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:06.331872 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writing DB stats nova_cell1:SELECT=3 {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:06.332939 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:07.252925 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-1f8029e4-4a5e-41fc-9f18-73a8c4bcf47e admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:01:07.286757 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-1f8029e4-4a5e-41fc-9f18-73a8c4bcf47e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.962644 Aug 19 21:01:07.287760 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 2/3] 10.222.0.16 () {60 vars in 1292 bytes} [Fri Aug 19 21:01:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:01:09.690242 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-7fb498e7-5870-477d-88ff-f312136f18fc None None] Calling method '>' {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:01:09.691198 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-7fb498e7-5870-477d-88ff-f312136f18fc None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 19 21:01:09.693091 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 2/4] 10.222.0.16 () {54 vars in 931 bytes} [Fri Aug 19 21:01:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:01:10.159745 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-b5a61235-2981-4f97-99a2-077fc8d8d8cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "disk": 1, "ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256"}} {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:01:10.180854 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 21:01:10.180854 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: warnings.warn(msg) Aug 19 21:01:10.210540 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-b5a61235-2981-4f97-99a2-077fc8d8d8cb admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.511115 Aug 19 21:01:10.211098 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 3/5] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Aug 19 21:01:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 21:01:10.229846 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG dbcounter [-] [105792] Writing DB stats nova_api:SELECT=3 {{(pid=105792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:10.230860 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG dbcounter [-] [105792] Writing DB stats nova_cell0:SELECT=3 {{(pid=105792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:10.232158 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG dbcounter [-] [105792] Writing DB stats nova_cell1:SELECT=3 {{(pid=105792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:10.233232 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG dbcounter [-] [105792] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:10.450893 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-4b91cf33-c5e3-4a1a-b345-f7775dfc0186 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:01:10.455467 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 21:01:10.455467 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: warnings.warn(msg) Aug 19 21:01:10.520365 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-4b91cf33-c5e3-4a1a-b345-f7775dfc0186 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.298154 Aug 19 21:01:10.521880 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 3/6] 10.222.0.16 () {64 vars in 1336 bytes} [Fri Aug 19 21:01:10 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:01:12.983723 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-b5a61235-2981-4f97-99a2-077fc8d8d8cb admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:01:12.985908 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-b5a61235-2981-4f97-99a2-077fc8d8d8cb admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002215 Aug 19 21:01:12.987072 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 4/7] 10.222.0.16 () {54 vars in 931 bytes} [Fri Aug 19 21:01:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:01:13.743624 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-2bf1443f-9622-4275-bbc8-fdb25e8fd035 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "ram": 512, "name": "ds512M"}} {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:01:13.762817 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 21:01:13.762817 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: warnings.warn(msg) Aug 19 21:01:13.785198 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-2bf1443f-9622-4275-bbc8-fdb25e8fd035 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.790011 Aug 19 21:01:13.788920 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 4/8] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Aug 19 21:01:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 21:01:13.799873 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-b2f0ab1c-2210-4b05-b93a-3fddbdf2a512 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:01:13.803386 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 21:01:13.803386 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: warnings.warn(msg) Aug 19 21:01:13.846032 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-b2f0ab1c-2210-4b05-b93a-3fddbdf2a512 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050615 Aug 19 21:01:13.849964 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 5/9] 10.222.0.16 () {64 vars in 1336 bytes} [Fri Aug 19 21:01:13 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:01:16.319033 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-2bf1443f-9622-4275-bbc8-fdb25e8fd035 admin admin] Calling method '>' {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:01:16.320058 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-2bf1443f-9622-4275-bbc8-fdb25e8fd035 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002320 Aug 19 21:01:16.320460 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 931 bytes} [Fri Aug 19 21:01:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:01:16.732413 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-9a817d21-3adf-4760-af38-e9541987304e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "id": "d2", "disk": 10, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:01:16.758244 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-9a817d21-3adf-4760-af38-e9541987304e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.431461 Aug 19 21:01:16.758909 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 6/11] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Aug 19 21:01:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 21:01:16.772230 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-4f21c6c9-f04d-40a5-912b-a785560660e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:01:16.796885 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-4f21c6c9-f04d-40a5-912b-a785560660e6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029123 Aug 19 21:01:16.797476 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 6/12] 10.222.0.16 () {64 vars in 1336 bytes} [Fri Aug 19 21:01:16 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:01:19.256248 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-9a817d21-3adf-4760-af38-e9541987304e admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:01:19.258080 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-9a817d21-3adf-4760-af38-e9541987304e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002934 Aug 19 21:01:19.258649 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 7/13] 10.222.0.16 () {54 vars in 931 bytes} [Fri Aug 19 21:01:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:01:19.758378 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-72c4b8ed-e658-4467-a263-dd3475b23f11 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "swap": 0, "disk": 10, "rxtx_factor": 1.0, "vcpus": 2, "ram": 2048, "id": "d3"}} {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:01:19.780351 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-72c4b8ed-e658-4467-a263-dd3475b23f11 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.514264 Aug 19 21:01:19.781032 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 7/14] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Aug 19 21:01:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 21:01:19.793539 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-08904f4e-1c5d-44de-88fc-473b08084338 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:01:19.823719 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-08904f4e-1c5d-44de-88fc-473b08084338 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033758 Aug 19 21:01:19.824680 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 8/15] 10.222.0.16 () {64 vars in 1336 bytes} [Fri Aug 19 21:01:19 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:01:22.248461 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-72c4b8ed-e658-4467-a263-dd3475b23f11 admin admin] Calling method '>' {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:01:22.250942 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-72c4b8ed-e658-4467-a263-dd3475b23f11 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003875 Aug 19 21:01:22.251850 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 8/16] 10.222.0.16 () {54 vars in 931 bytes} [Fri Aug 19 21:01:22 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:01:22.724085 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-b31e7f82-0fed-42df-bc4a-7d524ad24bd9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "swap": 0, "id": "d4", "disk": 20, "vcpus": 4, "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:01:22.745920 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-b31e7f82-0fed-42df-bc4a-7d524ad24bd9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.486553 Aug 19 21:01:22.746855 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 9/17] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Aug 19 21:01:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 21:01:22.759724 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-83a76383-3fd7-4f22-a976-8916a7683915 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:01:22.785958 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-83a76383-3fd7-4f22-a976-8916a7683915 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030505 Aug 19 21:01:22.786613 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 9/18] 10.222.0.16 () {64 vars in 1336 bytes} [Fri Aug 19 21:01:22 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:01:25.567033 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-b31e7f82-0fed-42df-bc4a-7d524ad24bd9 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:01:25.568766 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-b31e7f82-0fed-42df-bc4a-7d524ad24bd9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 19 21:01:25.569175 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 10/19] 10.222.0.16 () {54 vars in 931 bytes} [Fri Aug 19 21:01:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:01:26.117299 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-95512825-7ee5-44b8-9dfb-d78ee01b55a3 admin admin] Calling method '>' {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:01:26.151421 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-95512825-7ee5-44b8-9dfb-d78ee01b55a3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.574963 Aug 19 21:01:26.152153 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 10/20] 10.222.0.16 () {60 vars in 1292 bytes} [Fri Aug 19 21:01:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:01:29.196323 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-b31e7f82-0fed-42df-bc4a-7d524ad24bd9 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:01:29.197384 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-b31e7f82-0fed-42df-bc4a-7d524ad24bd9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 19 21:01:29.198012 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 11/21] 10.222.0.16 () {54 vars in 931 bytes} [Fri Aug 19 21:01:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:01:29.626815 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-1e8f35ed-15b2-48b0-acb6-8b7faa4eec73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "id": "1", "swap": 0, "disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:01:29.646073 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-1e8f35ed-15b2-48b0-acb6-8b7faa4eec73 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.441750 Aug 19 21:01:29.646525 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 11/22] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Aug 19 21:01:29 2022] POST /compute/v2.1/flavors => generated 402 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 21:01:29.658837 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-47490091-b2c0-472b-a55a-f65ab6cf85eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:01:29.683933 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-47490091-b2c0-472b-a55a-f65ab6cf85eb admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028873 Aug 19 21:01:29.684513 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 12/23] 10.222.0.16 () {64 vars in 1333 bytes} [Fri Aug 19 21:01:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:01:32.070028 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-1e8f35ed-15b2-48b0-acb6-8b7faa4eec73 admin admin] Calling method '>' {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:01:32.071046 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-1e8f35ed-15b2-48b0-acb6-8b7faa4eec73 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 19 21:01:32.071452 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 931 bytes} [Fri Aug 19 21:01:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:01:32.506778 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-009a7618-e0f3-4051-8283-557a121ad3e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "id": "2", "disk": 20, "name": "m1.small", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:01:32.527781 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-009a7618-e0f3-4051-8283-557a121ad3e3 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.450140 Aug 19 21:01:32.528334 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 13/25] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Aug 19 21:01:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 21:01:32.541285 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-26b85ec2-0594-46ba-908f-339814f6b1cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:01:32.569198 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-26b85ec2-0594-46ba-908f-339814f6b1cc admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032108 Aug 19 21:01:32.569808 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 13/26] 10.222.0.16 () {64 vars in 1333 bytes} [Fri Aug 19 21:01:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:01:35.002996 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-009a7618-e0f3-4051-8283-557a121ad3e3 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:01:35.004606 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-009a7618-e0f3-4051-8283-557a121ad3e3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002053 Aug 19 21:01:35.005897 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 14/27] 10.222.0.16 () {54 vars in 931 bytes} [Fri Aug 19 21:01:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:01:35.490864 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-3a70d0e1-6b81-4f37-a40e-bca71a88220a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 4096, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2}} {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:01:35.520863 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-3a70d0e1-6b81-4f37-a40e-bca71a88220a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.506316 Aug 19 21:01:35.522361 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 14/28] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Aug 19 21:01:35 2022] POST /compute/v2.1/flavors => generated 406 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 21:01:35.534441 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-2cc7c286-79d5-43ee-91ff-b203d3759e16 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:01:35.565389 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-2cc7c286-79d5-43ee-91ff-b203d3759e16 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034522 Aug 19 21:01:35.566324 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 15/29] 10.222.0.16 () {64 vars in 1333 bytes} [Fri Aug 19 21:01:35 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:01:38.053517 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-3a70d0e1-6b81-4f37-a40e-bca71a88220a admin admin] Calling method '>' {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:01:38.054590 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-3a70d0e1-6b81-4f37-a40e-bca71a88220a admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001596 Aug 19 21:01:38.056798 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 15/30] 10.222.0.16 () {54 vars in 931 bytes} [Fri Aug 19 21:01:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:01:38.518312 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-7d7d6f11-f99b-4fc7-89ae-9314ca5a4c0b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "name": "m1.large", "id": "4", "disk": 80}} {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:01:38.527897 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:38.540232 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-7d7d6f11-f99b-4fc7-89ae-9314ca5a4c0b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.478911 Aug 19 21:01:38.541079 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 16/31] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Aug 19 21:01:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 21:01:38.555008 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-dfeb65df-a6e1-4f82-905f-d3cbbff5bf38 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:01:38.581046 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-dfeb65df-a6e1-4f82-905f-d3cbbff5bf38 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030521 Aug 19 21:01:38.581637 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 16/32] 10.222.0.16 () {64 vars in 1333 bytes} [Fri Aug 19 21:01:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:01:41.054229 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-7d7d6f11-f99b-4fc7-89ae-9314ca5a4c0b admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:01:41.056009 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-7d7d6f11-f99b-4fc7-89ae-9314ca5a4c0b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002354 Aug 19 21:01:41.066110 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 17/33] 10.222.0.16 () {54 vars in 931 bytes} [Fri Aug 19 21:01:41 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:01:41.589046 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-38a397fb-0ef8-4c08-9812-f5caf88f4f6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0, "id": "5"}} {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:01:41.595769 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG dbcounter [-] [105792] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:01:41.612319 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-38a397fb-0ef8-4c08-9812-f5caf88f4f6f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.548639 Aug 19 21:01:41.613145 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 17/34] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Aug 19 21:01:41 2022] POST /compute/v2.1/flavors => generated 408 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 21:01:41.626523 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-223e5999-bd07-4c30-9947-1f330940d7f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:01:41.662929 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-223e5999-bd07-4c30-9947-1f330940d7f8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040294 Aug 19 21:01:41.663506 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 18/35] 10.222.0.16 () {64 vars in 1333 bytes} [Fri Aug 19 21:01:41 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:01:59.578620 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-38a397fb-0ef8-4c08-9812-f5caf88f4f6f admin admin] Calling method '>' {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:01:59.579644 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-38a397fb-0ef8-4c08-9812-f5caf88f4f6f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Aug 19 21:01:59.580046 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 18/36] 10.222.0.16 () {54 vars in 931 bytes} [Fri Aug 19 21:01:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:01:59.593408 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:02:00.075926 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-c7cd26f0-0f3f-4c8a-9eae-2a856feeb0cd admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:02:00.095704 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-c7cd26f0-0f3f-4c8a-9eae-2a856feeb0cd admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.507833 Aug 19 21:02:00.096263 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 19/37] 10.222.0.16 () {60 vars in 1292 bytes} [Fri Aug 19 21:01:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:02:01.311215 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-38a397fb-0ef8-4c08-9812-f5caf88f4f6f admin admin] Calling method '>' {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:02:01.312247 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-38a397fb-0ef8-4c08-9812-f5caf88f4f6f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002623 Aug 19 21:02:01.312651 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 19/38] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Aug 19 21:02:01 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:02:01.857226 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-992e3c86-a328-4a5a-8c5a-b8963f3e8de9 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:02:01.862884 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.wsgi [None req-992e3c86-a328-4a5a-8c5a-b8963f3e8de9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 19 21:02:01.866806 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-992e3c86-a328-4a5a-8c5a-b8963f3e8de9 admin admin] Request method failure captured: Aug 19 21:02:01.866806 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 19 21:02:01.866806 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: Accept: application/json Aug 19 21:02:01.866806 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: Accept-Encoding: gzip, deflate Aug 19 21:02:01.866806 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: Connection: keep-alive Aug 19 21:02:01.866806 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: Content-Length: 0 Aug 19 21:02:01.866806 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: Host: 10.222.0.16 Aug 19 21:02:01.866806 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: Openstack-Api-Version: compute 2.90 Aug 19 21:02:01.866806 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: Openstack-System-Scope: None Aug 19 21:02:01.866806 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: User-Agent: python-novaclient Aug 19 21:02:01.866806 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Auth-Token: gAAAAABi__pJIT5mia9UyEAfVKGC0DU0vCngArVgrSgmNYn75xRGV_6CH0j3OA3tPH9HMihMPP2mpF9wSgBOvmWfHNCeVlCqdXqBGGayIe-AW-Jlem5hDp3xzsjkNCx6U2fNN_AuPRNVY9_gZhfOWvYCgUp3eJrv_3xTAAmHt1steM76XJq-8CQ Aug 19 21:02:01.866806 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Domain-Id: None Aug 19 21:02:01.866806 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Domain-Name: None Aug 19 21:02:01.866806 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Identity-Status: Confirmed Aug 19 21:02:01.866806 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Is-Admin-Project: True Aug 19 21:02:01.866806 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Openstack-Nova-Api-Version: 2.90 Aug 19 21:02:01.866806 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Project-Domain-Id: default Aug 19 21:02:01.866806 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Project-Domain-Name: Default Aug 19 21:02:01.866806 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Project-Id: 4f484db3eb0540218c8a18fc8601facf Aug 19 21:02:01.866806 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Project-Name: admin Aug 19 21:02:01.866806 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Role: member,reader,admin Aug 19 21:02:01.866806 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Roles: member,reader,admin Aug 19 21:02:01.868461 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f484db3eb0540218c8a18fc8601facf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f484db3eb0540218c8a18fc8601facf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f484db3eb0540218c8a18fc8601facf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f484db3eb0540218c8a18fc8601facf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:02:01.868461 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Tenant: admin Aug 19 21:02:01.868461 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Tenant-Id: 4f484db3eb0540218c8a18fc8601facf Aug 19 21:02:01.868461 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Tenant-Name: admin Aug 19 21:02:01.868461 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-User: admin Aug 19 21:02:01.868461 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-User-Domain-Id: default Aug 19 21:02:01.868461 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-User-Domain-Name: Default Aug 19 21:02:01.868461 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-User-Id: 3476c91ad03941919217e0940471d201 Aug 19 21:02:01.868461 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-User-Name: admin Aug 19 21:02:01.868461 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: method: > Aug 19 21:02:01.868461 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: exception: Flavor 42 could not be found. Aug 19 21:02:01.868461 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: action_args: {'id': '42'} Aug 19 21:02:01.868461 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:02:01.868461 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:02:01.869417 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 19 21:02:01.869417 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 19 21:02:01.869417 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 19 21:02:01.869417 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 19 21:02:01.869417 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 19 21:02:01.869417 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 19 21:02:01.869417 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 19 21:02:01.869417 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 19 21:02:01.869417 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 19 21:02:01.869417 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:02:01.869417 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 19 21:02:01.869417 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 19 21:02:01.869417 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 19 21:02:01.869417 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Aug 19 21:02:01.869417 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:02:01.869417 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Aug 19 21:02:01.869417 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:02:01.869417 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:02:01.869417 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:02:01.870569 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:02:01.870569 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:02:01.870569 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:02:01.870569 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:02:01.870569 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 19 21:02:01.870569 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:02:01.870569 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 19 21:02:01.870569 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Aug 19 21:02:01.870569 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:02:01.870569 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Aug 19 21:02:01.870569 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:02:01.870569 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:02:01.870569 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:02:01.870569 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:02:01.870569 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:02:01.870569 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 19 21:02:01.870569 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Aug 19 21:02:01.870569 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-992e3c86-a328-4a5a-8c5a-b8963f3e8de9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:02:01.871632 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-992e3c86-a328-4a5a-8c5a-b8963f3e8de9 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.414371 Aug 19 21:02:01.871632 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 20/39] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Aug 19 21:02:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 415 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 19 21:02:01.878285 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-6471730e-462f-4885-8294-5b9c94836b80 admin admin] Calling method '>' {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:02:01.901472 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-6471730e-462f-4885-8294-5b9c94836b80 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026783 Aug 19 21:02:01.902063 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 20/40] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Aug 19 21:02:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:02:01.912219 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-d75b38f4-9b09-4642-9992-f11d23cf8f0a admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:02:01.937534 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-d75b38f4-9b09-4642-9992-f11d23cf8f0a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028881 Aug 19 21:02:01.938046 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 21/41] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Aug 19 21:02:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:02:01.950052 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-d131fb91-6e99-4d77-89aa-6c8004c944e2 admin admin] Calling method '>' {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:02:01.955968 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.wsgi [None req-d131fb91-6e99-4d77-89aa-6c8004c944e2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 19 21:02:01.959326 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-d131fb91-6e99-4d77-89aa-6c8004c944e2 admin admin] Request method failure captured: Aug 19 21:02:01.959326 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 19 21:02:01.959326 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: Accept: application/json Aug 19 21:02:01.959326 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: Accept-Encoding: gzip, deflate Aug 19 21:02:01.959326 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: Connection: keep-alive Aug 19 21:02:01.959326 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: Content-Length: 0 Aug 19 21:02:01.959326 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: Host: 10.222.0.16 Aug 19 21:02:01.959326 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: Openstack-Api-Version: compute 2.90 Aug 19 21:02:01.959326 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: Openstack-System-Scope: None Aug 19 21:02:01.959326 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: User-Agent: python-novaclient Aug 19 21:02:01.959326 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Auth-Token: gAAAAABi__pJIT5mia9UyEAfVKGC0DU0vCngArVgrSgmNYn75xRGV_6CH0j3OA3tPH9HMihMPP2mpF9wSgBOvmWfHNCeVlCqdXqBGGayIe-AW-Jlem5hDp3xzsjkNCx6U2fNN_AuPRNVY9_gZhfOWvYCgUp3eJrv_3xTAAmHt1steM76XJq-8CQ Aug 19 21:02:01.959326 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Domain-Id: None Aug 19 21:02:01.959326 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Domain-Name: None Aug 19 21:02:01.959326 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Identity-Status: Confirmed Aug 19 21:02:01.959326 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Is-Admin-Project: True Aug 19 21:02:01.959326 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Openstack-Nova-Api-Version: 2.90 Aug 19 21:02:01.959326 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Project-Domain-Id: default Aug 19 21:02:01.959326 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Project-Domain-Name: Default Aug 19 21:02:01.959326 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Project-Id: 4f484db3eb0540218c8a18fc8601facf Aug 19 21:02:01.959326 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Project-Name: admin Aug 19 21:02:01.959326 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Role: member,reader,admin Aug 19 21:02:01.959326 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Roles: member,reader,admin Aug 19 21:02:01.960883 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f484db3eb0540218c8a18fc8601facf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f484db3eb0540218c8a18fc8601facf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f484db3eb0540218c8a18fc8601facf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f484db3eb0540218c8a18fc8601facf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:02:01.960883 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Tenant: admin Aug 19 21:02:01.960883 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Tenant-Id: 4f484db3eb0540218c8a18fc8601facf Aug 19 21:02:01.960883 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Tenant-Name: admin Aug 19 21:02:01.960883 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-User: admin Aug 19 21:02:01.960883 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-User-Domain-Id: default Aug 19 21:02:01.960883 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-User-Domain-Name: Default Aug 19 21:02:01.960883 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-User-Id: 3476c91ad03941919217e0940471d201 Aug 19 21:02:01.960883 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-User-Name: admin Aug 19 21:02:01.960883 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: method: > Aug 19 21:02:01.960883 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: exception: Flavor 42 could not be found. Aug 19 21:02:01.960883 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: action_args: {'id': '42'} Aug 19 21:02:01.960883 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:02:01.960883 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:02:01.961965 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 19 21:02:01.961965 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 19 21:02:01.961965 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 19 21:02:01.961965 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 19 21:02:01.961965 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 19 21:02:01.961965 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 19 21:02:01.961965 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 19 21:02:01.961965 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 19 21:02:01.961965 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 19 21:02:01.961965 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:02:01.961965 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 19 21:02:01.961965 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 19 21:02:01.961965 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 19 21:02:01.961965 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi Aug 19 21:02:01.961965 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:02:01.961965 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi Aug 19 21:02:01.961965 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:02:01.961965 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:02:01.961965 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:02:01.963138 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:02:01.963138 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:02:01.963138 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:02:01.963138 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:02:01.963138 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 19 21:02:01.963138 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:02:01.963138 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 19 21:02:01.963138 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi Aug 19 21:02:01.963138 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:02:01.963138 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi Aug 19 21:02:01.963138 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:02:01.963138 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:02:01.963138 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:02:01.963138 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:02:01.963138 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:02:01.963138 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 19 21:02:01.963138 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi Aug 19 21:02:01.963138 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-d131fb91-6e99-4d77-89aa-6c8004c944e2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:02:01.964185 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-d131fb91-6e99-4d77-89aa-6c8004c944e2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015458 Aug 19 21:02:01.964185 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 21/42] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Aug 19 21:02:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 19 21:02:03.072242 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-d75b38f4-9b09-4642-9992-f11d23cf8f0a admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:02:03.073282 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-d75b38f4-9b09-4642-9992-f11d23cf8f0a admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 19 21:02:03.073676 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 22/43] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Aug 19 21:02:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:02:03.637657 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-3428de8b-2504-4268-afbc-85f1e6fe0d3f admin admin] Calling method '>' {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:02:03.643650 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.wsgi [None req-3428de8b-2504-4268-afbc-85f1e6fe0d3f admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 19 21:02:03.645644 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-3428de8b-2504-4268-afbc-85f1e6fe0d3f admin admin] Request method failure captured: Aug 19 21:02:03.645644 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 19 21:02:03.645644 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: Accept: application/json Aug 19 21:02:03.645644 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: Accept-Encoding: gzip, deflate Aug 19 21:02:03.645644 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: Connection: keep-alive Aug 19 21:02:03.645644 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: Content-Length: 0 Aug 19 21:02:03.645644 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: Host: 10.222.0.16 Aug 19 21:02:03.645644 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: Openstack-Api-Version: compute 2.90 Aug 19 21:02:03.645644 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: Openstack-System-Scope: None Aug 19 21:02:03.645644 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: User-Agent: python-novaclient Aug 19 21:02:03.645644 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Auth-Token: gAAAAABi__pKRpEkvyH7VgFUuTvZSiQVhBZyvLNtB80zhZtclfSQ8yr7tPA1obzUCIii8oHGQleRnC9MKHQS53lisBakFOLpb4iaZb2jZyvzRFVqbkgQEXCb2bU6PrCYtlb9CQfjnGBKfZO7LfryEt-o0Ty0jUGyHbW_0sSOkLgT_8h5Qkpw1CI Aug 19 21:02:03.645644 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Domain-Id: None Aug 19 21:02:03.645644 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Domain-Name: None Aug 19 21:02:03.645644 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Identity-Status: Confirmed Aug 19 21:02:03.645644 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Is-Admin-Project: True Aug 19 21:02:03.645644 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Openstack-Nova-Api-Version: 2.90 Aug 19 21:02:03.645644 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Project-Domain-Id: default Aug 19 21:02:03.645644 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Project-Domain-Name: Default Aug 19 21:02:03.645644 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Project-Id: 4f484db3eb0540218c8a18fc8601facf Aug 19 21:02:03.645644 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Project-Name: admin Aug 19 21:02:03.645644 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Role: member,reader,admin Aug 19 21:02:03.645644 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Roles: member,reader,admin Aug 19 21:02:03.647211 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f484db3eb0540218c8a18fc8601facf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f484db3eb0540218c8a18fc8601facf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f484db3eb0540218c8a18fc8601facf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f484db3eb0540218c8a18fc8601facf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:02:03.647211 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Tenant: admin Aug 19 21:02:03.647211 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Tenant-Id: 4f484db3eb0540218c8a18fc8601facf Aug 19 21:02:03.647211 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Tenant-Name: admin Aug 19 21:02:03.647211 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-User: admin Aug 19 21:02:03.647211 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-User-Domain-Id: default Aug 19 21:02:03.647211 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-User-Domain-Name: Default Aug 19 21:02:03.647211 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-User-Id: 3476c91ad03941919217e0940471d201 Aug 19 21:02:03.647211 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-User-Name: admin Aug 19 21:02:03.647211 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: method: > Aug 19 21:02:03.647211 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: exception: Flavor 84 could not be found. Aug 19 21:02:03.647211 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: action_args: {'id': '84'} Aug 19 21:02:03.647211 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:02:03.647211 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:02:03.648277 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 19 21:02:03.648277 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 19 21:02:03.648277 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 19 21:02:03.648277 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 19 21:02:03.648277 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 19 21:02:03.648277 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 19 21:02:03.648277 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 19 21:02:03.648277 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 19 21:02:03.648277 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 19 21:02:03.648277 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:02:03.648277 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 19 21:02:03.648277 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 19 21:02:03.648277 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 19 21:02:03.648277 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi Aug 19 21:02:03.648277 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:02:03.648277 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi Aug 19 21:02:03.648277 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:02:03.648277 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:02:03.648277 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:02:03.649902 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:02:03.649902 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:02:03.649902 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:02:03.649902 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:02:03.649902 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 19 21:02:03.649902 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:02:03.649902 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 19 21:02:03.649902 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi Aug 19 21:02:03.649902 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:02:03.649902 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi Aug 19 21:02:03.649902 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:02:03.649902 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:02:03.649902 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:02:03.649902 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:02:03.649902 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:02:03.649902 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 19 21:02:03.649902 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi Aug 19 21:02:03.649902 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-3428de8b-2504-4268-afbc-85f1e6fe0d3f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:02:03.651171 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-3428de8b-2504-4268-afbc-85f1e6fe0d3f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.429618 Aug 19 21:02:03.651171 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Aug 19 21:02:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 431 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 19 21:02:03.657272 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-c6bc73bc-1e93-4a0a-9b87-b46509105999 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:02:03.673558 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-c6bc73bc-1e93-4a0a-9b87-b46509105999 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019849 Aug 19 21:02:03.674160 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 23/45] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Aug 19 21:02:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:02:03.685518 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-62667250-b13a-4f1a-ba85-c362b10ab141 admin admin] Calling method '>' {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:02:03.702066 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-62667250-b13a-4f1a-ba85-c362b10ab141 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020066 Aug 19 21:02:03.702630 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Aug 19 21:02:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:02:03.713179 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-144eb44b-9fa7-4ce0-a43e-1888c995bfa9 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:02:03.718657 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.wsgi [None req-144eb44b-9fa7-4ce0-a43e-1888c995bfa9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 19 21:02:03.720152 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-144eb44b-9fa7-4ce0-a43e-1888c995bfa9 admin admin] Request method failure captured: Aug 19 21:02:03.720152 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 19 21:02:03.720152 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: Accept: application/json Aug 19 21:02:03.720152 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: Accept-Encoding: gzip, deflate Aug 19 21:02:03.720152 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: Connection: keep-alive Aug 19 21:02:03.720152 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: Content-Length: 0 Aug 19 21:02:03.720152 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: Host: 10.222.0.16 Aug 19 21:02:03.720152 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: Openstack-Api-Version: compute 2.90 Aug 19 21:02:03.720152 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: Openstack-System-Scope: None Aug 19 21:02:03.720152 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: User-Agent: python-novaclient Aug 19 21:02:03.720152 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Auth-Token: gAAAAABi__pKRpEkvyH7VgFUuTvZSiQVhBZyvLNtB80zhZtclfSQ8yr7tPA1obzUCIii8oHGQleRnC9MKHQS53lisBakFOLpb4iaZb2jZyvzRFVqbkgQEXCb2bU6PrCYtlb9CQfjnGBKfZO7LfryEt-o0Ty0jUGyHbW_0sSOkLgT_8h5Qkpw1CI Aug 19 21:02:03.720152 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Domain-Id: None Aug 19 21:02:03.720152 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Domain-Name: None Aug 19 21:02:03.720152 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Identity-Status: Confirmed Aug 19 21:02:03.720152 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Is-Admin-Project: True Aug 19 21:02:03.720152 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Openstack-Nova-Api-Version: 2.90 Aug 19 21:02:03.720152 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Project-Domain-Id: default Aug 19 21:02:03.720152 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Project-Domain-Name: Default Aug 19 21:02:03.720152 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Project-Id: 4f484db3eb0540218c8a18fc8601facf Aug 19 21:02:03.720152 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Project-Name: admin Aug 19 21:02:03.720152 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Role: member,reader,admin Aug 19 21:02:03.720152 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Roles: member,reader,admin Aug 19 21:02:03.721871 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f484db3eb0540218c8a18fc8601facf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f484db3eb0540218c8a18fc8601facf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f484db3eb0540218c8a18fc8601facf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f484db3eb0540218c8a18fc8601facf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:02:03.721871 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Tenant: admin Aug 19 21:02:03.721871 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Tenant-Id: 4f484db3eb0540218c8a18fc8601facf Aug 19 21:02:03.721871 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Tenant-Name: admin Aug 19 21:02:03.721871 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-User: admin Aug 19 21:02:03.721871 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-User-Domain-Id: default Aug 19 21:02:03.721871 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-User-Domain-Name: Default Aug 19 21:02:03.721871 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-User-Id: 3476c91ad03941919217e0940471d201 Aug 19 21:02:03.721871 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-User-Name: admin Aug 19 21:02:03.721871 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: method: > Aug 19 21:02:03.721871 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: exception: Flavor 84 could not be found. Aug 19 21:02:03.721871 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: action_args: {'id': '84'} Aug 19 21:02:03.721871 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:02:03.721871 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:02:03.722814 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 19 21:02:03.722814 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 19 21:02:03.722814 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 19 21:02:03.722814 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 19 21:02:03.722814 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 19 21:02:03.722814 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 19 21:02:03.722814 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 19 21:02:03.722814 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 19 21:02:03.722814 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 19 21:02:03.722814 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:02:03.722814 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 19 21:02:03.722814 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 19 21:02:03.722814 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 19 21:02:03.722814 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Aug 19 21:02:03.722814 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:02:03.722814 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Aug 19 21:02:03.722814 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:02:03.722814 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:02:03.722814 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:02:03.724693 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:02:03.724693 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:02:03.724693 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:02:03.724693 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:02:03.724693 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 19 21:02:03.724693 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:02:03.724693 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 19 21:02:03.724693 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Aug 19 21:02:03.724693 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:02:03.724693 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Aug 19 21:02:03.724693 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:02:03.724693 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:02:03.724693 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:02:03.724693 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:02:03.724693 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:02:03.724693 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 19 21:02:03.724693 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Aug 19 21:02:03.724693 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-144eb44b-9fa7-4ce0-a43e-1888c995bfa9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:02:03.726016 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-144eb44b-9fa7-4ce0-a43e-1888c995bfa9 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012019 Aug 19 21:02:03.726016 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 24/47] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Aug 19 21:02:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 19 21:02:04.706227 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-62667250-b13a-4f1a-ba85-c362b10ab141 admin admin] Calling method '>' {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:02:04.707240 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-62667250-b13a-4f1a-ba85-c362b10ab141 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001598 Aug 19 21:02:04.707653 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 24/48] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Aug 19 21:02:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:02:05.263161 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-db2e5cd9-38c8-4114-b886-0b51318f8a7a admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:02:05.268853 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.wsgi [None req-db2e5cd9-38c8-4114-b886-0b51318f8a7a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 19 21:02:05.271249 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-db2e5cd9-38c8-4114-b886-0b51318f8a7a admin admin] Request method failure captured: Aug 19 21:02:05.271249 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 19 21:02:05.271249 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: Accept: application/json Aug 19 21:02:05.271249 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: Accept-Encoding: gzip, deflate Aug 19 21:02:05.271249 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: Connection: keep-alive Aug 19 21:02:05.271249 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: Content-Length: 0 Aug 19 21:02:05.271249 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: Host: 10.222.0.16 Aug 19 21:02:05.271249 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: Openstack-Api-Version: compute 2.90 Aug 19 21:02:05.271249 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: Openstack-System-Scope: None Aug 19 21:02:05.271249 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: User-Agent: python-novaclient Aug 19 21:02:05.271249 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Auth-Token: gAAAAABi__pMhnU9QOWMXn-_t9BbS7hvHOz3VuYh2tHV9n4YK0NdAuDfxgVn87flEjBE9sGizhSV6U9DhtTlJ3qgWk2eLekYti4m9R7Qu4kf2_m_svXp1KfNTBf4TpziRHJfe4dnOUyFtHmoQVXZ1CgigoN8dmXCtXXQCyeu41CZAswqOn6nyAA Aug 19 21:02:05.271249 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Domain-Id: None Aug 19 21:02:05.271249 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Domain-Name: None Aug 19 21:02:05.271249 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Identity-Status: Confirmed Aug 19 21:02:05.271249 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Is-Admin-Project: True Aug 19 21:02:05.271249 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Openstack-Nova-Api-Version: 2.90 Aug 19 21:02:05.271249 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Project-Domain-Id: default Aug 19 21:02:05.271249 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Project-Domain-Name: Default Aug 19 21:02:05.271249 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Project-Id: 4f484db3eb0540218c8a18fc8601facf Aug 19 21:02:05.271249 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Project-Name: admin Aug 19 21:02:05.271249 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Role: member,reader,admin Aug 19 21:02:05.271249 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Roles: member,reader,admin Aug 19 21:02:05.272817 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f484db3eb0540218c8a18fc8601facf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f484db3eb0540218c8a18fc8601facf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f484db3eb0540218c8a18fc8601facf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f484db3eb0540218c8a18fc8601facf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:02:05.272817 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Tenant: admin Aug 19 21:02:05.272817 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Tenant-Id: 4f484db3eb0540218c8a18fc8601facf Aug 19 21:02:05.272817 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-Tenant-Name: admin Aug 19 21:02:05.272817 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-User: admin Aug 19 21:02:05.272817 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-User-Domain-Id: default Aug 19 21:02:05.272817 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-User-Domain-Name: Default Aug 19 21:02:05.272817 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-User-Id: 3476c91ad03941919217e0940471d201 Aug 19 21:02:05.272817 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: X-User-Name: admin Aug 19 21:02:05.272817 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: method: > Aug 19 21:02:05.272817 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: exception: Flavor 451 could not be found. Aug 19 21:02:05.272817 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: action_args: {'id': '451'} Aug 19 21:02:05.272817 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:02:05.272817 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:02:05.273971 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 19 21:02:05.273971 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 19 21:02:05.273971 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 19 21:02:05.273971 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 19 21:02:05.273971 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 19 21:02:05.273971 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 19 21:02:05.273971 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 19 21:02:05.273971 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 19 21:02:05.273971 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 19 21:02:05.273971 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:02:05.273971 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 19 21:02:05.273971 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 19 21:02:05.273971 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 19 21:02:05.273971 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Aug 19 21:02:05.273971 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:02:05.273971 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Aug 19 21:02:05.273971 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:02:05.273971 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:02:05.273971 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:02:05.275390 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:02:05.275390 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:02:05.275390 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:02:05.275390 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:02:05.275390 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 19 21:02:05.275390 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:02:05.275390 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 19 21:02:05.275390 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Aug 19 21:02:05.275390 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:02:05.275390 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Aug 19 21:02:05.275390 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:02:05.275390 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:02:05.275390 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:02:05.275390 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:02:05.275390 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:02:05.275390 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 19 21:02:05.275390 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: ERROR nova.api.openstack.wsgi Aug 19 21:02:05.275390 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-db2e5cd9-38c8-4114-b886-0b51318f8a7a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:02:05.276606 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-db2e5cd9-38c8-4114-b886-0b51318f8a7a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.425149 Aug 19 21:02:05.276606 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 25/49] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Aug 19 21:02:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 427 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 19 21:02:05.282376 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-3716c3cb-2f10-434d-a975-65a5840c10ee admin admin] Calling method '>' {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:02:05.298047 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-3716c3cb-2f10-434d-a975-65a5840c10ee admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019207 Aug 19 21:02:05.298579 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 25/50] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Aug 19 21:02:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:02:05.308833 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-87836656-0607-4c42-9c40-029bf9392588 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:02:05.325237 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-87836656-0607-4c42-9c40-029bf9392588 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019876 Aug 19 21:02:05.325818 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 26/51] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Aug 19 21:02:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:02:05.336312 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-ca9c49d6-83a7-4f5a-8d2b-21119afd6de0 admin admin] Calling method '>' {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:02:05.341752 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.wsgi [None req-ca9c49d6-83a7-4f5a-8d2b-21119afd6de0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 19 21:02:05.343356 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-ca9c49d6-83a7-4f5a-8d2b-21119afd6de0 admin admin] Request method failure captured: Aug 19 21:02:05.343356 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 19 21:02:05.343356 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: Accept: application/json Aug 19 21:02:05.343356 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: Accept-Encoding: gzip, deflate Aug 19 21:02:05.343356 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: Connection: keep-alive Aug 19 21:02:05.343356 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: Content-Length: 0 Aug 19 21:02:05.343356 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: Host: 10.222.0.16 Aug 19 21:02:05.343356 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: Openstack-Api-Version: compute 2.90 Aug 19 21:02:05.343356 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: Openstack-System-Scope: None Aug 19 21:02:05.343356 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: User-Agent: python-novaclient Aug 19 21:02:05.343356 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Auth-Token: gAAAAABi__pMhnU9QOWMXn-_t9BbS7hvHOz3VuYh2tHV9n4YK0NdAuDfxgVn87flEjBE9sGizhSV6U9DhtTlJ3qgWk2eLekYti4m9R7Qu4kf2_m_svXp1KfNTBf4TpziRHJfe4dnOUyFtHmoQVXZ1CgigoN8dmXCtXXQCyeu41CZAswqOn6nyAA Aug 19 21:02:05.343356 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Domain-Id: None Aug 19 21:02:05.343356 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Domain-Name: None Aug 19 21:02:05.343356 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Identity-Status: Confirmed Aug 19 21:02:05.343356 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Is-Admin-Project: True Aug 19 21:02:05.343356 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Openstack-Nova-Api-Version: 2.90 Aug 19 21:02:05.343356 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Project-Domain-Id: default Aug 19 21:02:05.343356 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Project-Domain-Name: Default Aug 19 21:02:05.343356 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Project-Id: 4f484db3eb0540218c8a18fc8601facf Aug 19 21:02:05.343356 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Project-Name: admin Aug 19 21:02:05.343356 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Role: member,reader,admin Aug 19 21:02:05.343356 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Roles: member,reader,admin Aug 19 21:02:05.344934 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f484db3eb0540218c8a18fc8601facf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f484db3eb0540218c8a18fc8601facf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f484db3eb0540218c8a18fc8601facf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f484db3eb0540218c8a18fc8601facf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:02:05.344934 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Tenant: admin Aug 19 21:02:05.344934 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Tenant-Id: 4f484db3eb0540218c8a18fc8601facf Aug 19 21:02:05.344934 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-Tenant-Name: admin Aug 19 21:02:05.344934 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-User: admin Aug 19 21:02:05.344934 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-User-Domain-Id: default Aug 19 21:02:05.344934 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-User-Domain-Name: Default Aug 19 21:02:05.344934 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-User-Id: 3476c91ad03941919217e0940471d201 Aug 19 21:02:05.344934 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: X-User-Name: admin Aug 19 21:02:05.344934 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: method: > Aug 19 21:02:05.344934 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: exception: Flavor 451 could not be found. Aug 19 21:02:05.344934 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: action_args: {'id': '451'} Aug 19 21:02:05.344934 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:02:05.344934 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:02:05.346142 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 19 21:02:05.346142 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 19 21:02:05.346142 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 19 21:02:05.346142 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 19 21:02:05.346142 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 19 21:02:05.346142 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 19 21:02:05.346142 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 19 21:02:05.346142 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 19 21:02:05.346142 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 19 21:02:05.346142 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:02:05.346142 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 19 21:02:05.346142 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 19 21:02:05.346142 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 19 21:02:05.346142 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi Aug 19 21:02:05.346142 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:02:05.346142 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi Aug 19 21:02:05.346142 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:02:05.346142 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:02:05.346142 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:02:05.347409 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:02:05.347409 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:02:05.347409 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:02:05.347409 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:02:05.347409 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 19 21:02:05.347409 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:02:05.347409 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 19 21:02:05.347409 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi Aug 19 21:02:05.347409 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:02:05.347409 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi Aug 19 21:02:05.347409 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:02:05.347409 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:02:05.347409 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:02:05.347409 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:02:05.347409 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:02:05.347409 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 19 21:02:05.347409 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: ERROR nova.api.openstack.wsgi Aug 19 21:02:05.347409 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-ca9c49d6-83a7-4f5a-8d2b-21119afd6de0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:02:05.348639 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-ca9c49d6-83a7-4f5a-8d2b-21119afd6de0 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012997 Aug 19 21:02:05.348639 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 26/52] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Aug 19 21:02:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 19 21:02:06.338213 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-87836656-0607-4c42-9c40-029bf9392588 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:02:06.339281 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-87836656-0607-4c42-9c40-029bf9392588 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Aug 19 21:02:06.339635 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 27/53] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Aug 19 21:02:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:02:06.892819 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-7d9826a1-67cd-4ce8-8001-222647d511d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:02:06.914022 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-7d9826a1-67cd-4ce8-8001-222647d511d8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.431111 Aug 19 21:02:06.914497 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 27/54] 10.222.0.16 () {64 vars in 1235 bytes} [Fri Aug 19 21:02:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 21:02:07.915011 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-87836656-0607-4c42-9c40-029bf9392588 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:02:07.916080 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-87836656-0607-4c42-9c40-029bf9392588 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Aug 19 21:02:07.916503 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Aug 19 21:02:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:02:08.467824 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-b602326c-bf02-41ff-b9dc-c3b9a094423f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:02:08.488476 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-b602326c-bf02-41ff-b9dc-c3b9a094423f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.417439 Aug 19 21:02:08.490162 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 28/56] 10.222.0.16 () {64 vars in 1235 bytes} [Fri Aug 19 21:02:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 21:02:09.490609 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-87836656-0607-4c42-9c40-029bf9392588 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:02:09.491649 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-87836656-0607-4c42-9c40-029bf9392588 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001894 Aug 19 21:02:09.492070 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 29/57] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Aug 19 21:02:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:02:10.035741 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-e72ba893-d7d0-4e9d-b777-895ca8492b4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:02:10.056298 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-e72ba893-d7d0-4e9d-b777-895ca8492b4e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.420299 Aug 19 21:02:10.056848 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 29/58] 10.222.0.16 () {64 vars in 1235 bytes} [Fri Aug 19 21:02:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 21:02:11.046925 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-87836656-0607-4c42-9c40-029bf9392588 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:02:11.047940 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-87836656-0607-4c42-9c40-029bf9392588 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 19 21:02:11.048336 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 30/59] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Aug 19 21:02:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:02:11.596601 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-587d2be2-01e3-476f-ab9c-4c722e713ece admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:02:11.622295 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-587d2be2-01e3-476f-ab9c-4c722e713ece admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.431445 Aug 19 21:02:11.623029 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 30/60] 10.222.0.16 () {64 vars in 1235 bytes} [Fri Aug 19 21:02:11 2022] POST /compute/v2.1/flavors => generated 409 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 21:02:12.666519 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-87836656-0607-4c42-9c40-029bf9392588 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:02:12.667618 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-87836656-0607-4c42-9c40-029bf9392588 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 19 21:02:12.667919 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 31/61] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Aug 19 21:02:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:02:13.203391 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-3128d0fd-d793-4df2-92ea-47e1b9c52871 admin admin] Calling method '>' {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:02:13.225463 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-3128d0fd-d793-4df2-92ea-47e1b9c52871 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.419662 Aug 19 21:02:13.226037 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 31/62] 10.222.0.16 () {60 vars in 1202 bytes} [Fri Aug 19 21:02:12 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:03:08.236684 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-87836656-0607-4c42-9c40-029bf9392588 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:03:08.237644 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-87836656-0607-4c42-9c40-029bf9392588 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Aug 19 21:03:08.238094 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 32/63] 10.222.0.16 () {54 vars in 931 bytes} [Fri Aug 19 21:03:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:03:08.249982 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG dbcounter [-] [105792] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:03:08.632369 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-97a63012-7a5a-49a4-9946-085565b75710 admin admin] Calling method '>' {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:03:08.653141 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-97a63012-7a5a-49a4-9946-085565b75710 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407792 Aug 19 21:03:08.653679 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 32/64] 10.222.0.16 () {60 vars in 1292 bytes} [Fri Aug 19 21:03:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:03:08.680951 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-28ab4705-fb30-48bb-86ba-0e604a2db1a6 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:03:08.684391 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG dbcounter [-] [105791] Writing DB stats nova_api:SELECT=14 {{(pid=105791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:03:08.690246 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-28ab4705-fb30-48bb-86ba-0e604a2db1a6 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014270 Aug 19 21:03:08.690774 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 33/65] 10.222.0.16 () {60 vars in 1283 bytes} [Fri Aug 19 21:03:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:03:08.702651 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-bf2a1bd5-1deb-4f0d-8c71-6d3539679b75 admin admin] Calling method '>' {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:03:08.711656 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-bf2a1bd5-1deb-4f0d-8c71-6d3539679b75 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012557 Aug 19 21:03:08.712200 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 33/66] 10.222.0.16 () {60 vars in 1286 bytes} [Fri Aug 19 21:03:08 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:03:08.724863 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-a5cdd424-6903-43da-9141-9880366e8863 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:03:08.732726 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-a5cdd424-6903-43da-9141-9880366e8863 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012368 Aug 19 21:03:08.733273 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 34/67] 10.222.0.16 () {60 vars in 1286 bytes} [Fri Aug 19 21:03:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:03:08.745642 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-f4df15ef-5c8e-4a7f-a135-7731154ad936 admin admin] Calling method '>' {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:03:08.754451 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-f4df15ef-5c8e-4a7f-a135-7731154ad936 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012345 Aug 19 21:03:08.755125 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 34/68] 10.222.0.16 () {60 vars in 1283 bytes} [Fri Aug 19 21:03:08 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:06:04.540164 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-a5cdd424-6903-43da-9141-9880366e8863 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:06:04.541201 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-a5cdd424-6903-43da-9141-9880366e8863 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002252 Aug 19 21:06:04.541565 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 35/69] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Aug 19 21:06:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:06:04.687555 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG dbcounter [-] [105792] Writing DB stats nova_api:SELECT=6 {{(pid=105792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:06:04.850103 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-a41fa352-fcf1-40cf-a86f-afd10d4b19ab admin admin] Calling method '>' {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:06:04.852462 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 21:06:04.852462 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: warnings.warn(msg) Aug 19 21:06:04.853626 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-a41fa352-fcf1-40cf-a86f-afd10d4b19ab admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:06:04.854141 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-a41fa352-fcf1-40cf-a86f-afd10d4b19ab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:06:04.854582 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-a41fa352-fcf1-40cf-a86f-afd10d4b19ab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:06:04.855302 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-a41fa352-fcf1-40cf-a86f-afd10d4b19ab admin admin] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:06:04.855749 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-a41fa352-fcf1-40cf-a86f-afd10d4b19ab admin admin] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:06:04.856168 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-a41fa352-fcf1-40cf-a86f-afd10d4b19ab admin admin] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:06:04.891254 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-a41fa352-fcf1-40cf-a86f-afd10d4b19ab admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.205290 Aug 19 21:06:04.891825 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 35/70] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Aug 19 21:06:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 21:06:05.747487 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-a5cdd424-6903-43da-9141-9880366e8863 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:06:05.748505 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-a5cdd424-6903-43da-9141-9880366e8863 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Aug 19 21:06:05.748908 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Aug 19 21:06:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:06:05.948341 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-a5cab97a-617a-49a9-9d68-0d4ca4e02071 admin admin] Calling method '>' {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:06:05.951609 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 21:06:05.951609 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: warnings.warn(msg) Aug 19 21:06:05.952781 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-a5cab97a-617a-49a9-9d68-0d4ca4e02071 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:06:05.953298 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-a5cab97a-617a-49a9-9d68-0d4ca4e02071 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:06:05.953726 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-a5cab97a-617a-49a9-9d68-0d4ca4e02071 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:06:05.954465 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-a5cab97a-617a-49a9-9d68-0d4ca4e02071 admin admin] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:06:05.954909 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-a5cab97a-617a-49a9-9d68-0d4ca4e02071 admin admin] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:06:05.955329 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-a5cab97a-617a-49a9-9d68-0d4ca4e02071 admin admin] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:06:05.975481 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-a5cab97a-617a-49a9-9d68-0d4ca4e02071 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.084079 Aug 19 21:06:05.976054 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 36/72] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Aug 19 21:06:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 21:06:17.212029 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-a5cdd424-6903-43da-9141-9880366e8863 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:06:17.214202 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-a5cdd424-6903-43da-9141-9880366e8863 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002532 Aug 19 21:06:17.214610 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 37/73] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Aug 19 21:06:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:06:17.362895 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG dbcounter [-] [105792] Writing DB stats nova_cell0:SELECT=4 {{(pid=105792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:06:17.364388 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG dbcounter [-] [105792] Writing DB stats nova_cell1:SELECT=4 {{(pid=105792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:06:17.365142 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG dbcounter [-] [105792] Writing DB stats nova_api:SELECT=8 {{(pid=105792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:06:17.416230 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-7c533ac8-698c-4be0-971d-b5b80dfce7bf admin admin] Calling method '>' {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:06:17.418640 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 21:06:17.418640 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: warnings.warn(msg) Aug 19 21:06:17.419767 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-7c533ac8-698c-4be0-971d-b5b80dfce7bf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:06:17.420303 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-7c533ac8-698c-4be0-971d-b5b80dfce7bf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:06:17.420715 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-7c533ac8-698c-4be0-971d-b5b80dfce7bf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:06:17.421405 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-7c533ac8-698c-4be0-971d-b5b80dfce7bf admin admin] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:06:17.421885 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-7c533ac8-698c-4be0-971d-b5b80dfce7bf admin admin] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:06:17.422308 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-7c533ac8-698c-4be0-971d-b5b80dfce7bf admin admin] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:06:17.449568 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-7c533ac8-698c-4be0-971d-b5b80dfce7bf admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.090914 Aug 19 21:06:17.450294 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 37/74] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Aug 19 21:06:17 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:06:18.292919 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: DEBUG nova.api.openstack.wsgi [None req-a5cdd424-6903-43da-9141-9880366e8863 admin admin] Calling method '>' {{(pid=105791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:06:18.293990 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: INFO nova.api.openstack.requestlog [None req-a5cdd424-6903-43da-9141-9880366e8863 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 19 21:06:18.294381 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: [pid: 105791|app: 0|req: 38/75] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Aug 19 21:06:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:06:18.488602 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG nova.api.openstack.wsgi [None req-dd831527-f0c0-4e66-ac87-5e32e748db2e admin admin] Calling method '>' {{(pid=105792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:06:18.491044 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 21:06:18.491044 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: warnings.warn(msg) Aug 19 21:06:18.492221 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-dd831527-f0c0-4e66-ac87-5e32e748db2e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:06:18.492703 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-dd831527-f0c0-4e66-ac87-5e32e748db2e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:06:18.493132 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-dd831527-f0c0-4e66-ac87-5e32e748db2e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:06:18.493931 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-dd831527-f0c0-4e66-ac87-5e32e748db2e admin admin] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:06:18.494887 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-dd831527-f0c0-4e66-ac87-5e32e748db2e admin admin] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:06:18.495307 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: DEBUG oslo_concurrency.lockutils [None req-dd831527-f0c0-4e66-ac87-5e32e748db2e admin admin] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:06:18.517058 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: INFO nova.api.openstack.requestlog [None req-dd831527-f0c0-4e66-ac87-5e32e748db2e admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081357 Aug 19 21:06:18.517614 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: [pid: 105792|app: 0|req: 38/76] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Aug 19 21:06:18 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:07:15.003441 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: Fri Aug 19 21:07:15 2022 - graceful shutdown triggered... Aug 19 21:07:15.004248 dv-cinder-852209-6-iscsi devstack@n-api.service[105792]: Gracefully killing worker 2 (pid: 105792)... Aug 19 21:07:15.003852 dv-cinder-852209-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 19 21:07:15.005617 dv-cinder-852209-6-iscsi devstack@n-api.service[105791]: Gracefully killing worker 1 (pid: 105791)... Aug 19 21:07:16.003884 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: worker 1 buried after 1 seconds Aug 19 21:07:16.003884 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: worker 2 buried after 1 seconds Aug 19 21:07:16.004732 dv-cinder-852209-6-iscsi devstack@n-api.service[105790]: goodbye to uWSGI. Aug 19 21:07:16.005562 dv-cinder-852209-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 19 21:07:16.006222 dv-cinder-852209-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 19 21:07:16.009599 dv-cinder-852209-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 19 21:07:16.023130 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 19 21:07:16.026693 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 19 21:07:16 2022] *** Aug 19 21:07:16.026693 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 19 21:07:16.026693 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 19 21:07:16.026693 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: nodename: dv-cinder-852209-6-iscsi Aug 19 21:07:16.026693 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: machine: x86_64 Aug 19 21:07:16.026693 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: clock source: unix Aug 19 21:07:16.026693 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: pcre jit disabled Aug 19 21:07:16.026693 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: detected number of CPU cores: 4 Aug 19 21:07:16.026693 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: current working directory: / Aug 19 21:07:16.026693 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: detected binary path: /usr/bin/uwsgi-core Aug 19 21:07:16.027876 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: your processes number limit is 47680 Aug 19 21:07:16.027876 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: your memory page size is 4096 bytes Aug 19 21:07:16.027876 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: detected max file descriptor number: 2048 Aug 19 21:07:16.027876 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: lock engine: pthread robust mutexes Aug 19 21:07:16.027876 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: thunder lock: enabled Aug 19 21:07:16.027876 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 19 21:07:16.027876 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 19 21:07:16.077898 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: Python main interpreter initialized at 0x559cd41539c0 Aug 19 21:07:16.077898 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: python threads support enabled Aug 19 21:07:16.077898 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: your server socket listen backlog is limited to 100 connections Aug 19 21:07:16.077898 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: your mercy for graceful operations on workers is 90 seconds Aug 19 21:07:16.078637 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: mapped 403077 bytes (393 KB) for 2 cores Aug 19 21:07:16.078763 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: *** Operational MODE: preforking *** Aug 19 21:07:16.080589 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: *** uWSGI is running in multiple interpreter mode *** Aug 19 21:07:16.080589 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: spawned uWSGI master process (pid: 120860) Aug 19 21:07:16.080589 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: spawned uWSGI worker 1 (pid: 120876, cores: 1) Aug 19 21:07:16.080589 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: spawned uWSGI worker 2 (pid: 120877, cores: 1) Aug 19 21:07:16.079583 dv-cinder-852209-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 19 21:07:16.081265 dv-cinder-852209-6-iscsi devstack@n-api.service[120860]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 19 21:07:16.815124 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 19 21:07:16.848679 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 19 21:07:18.169024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 21:07:18.169024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: from cryptography.utils import int_from_bytes Aug 19 21:07:18.170255 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 21:07:18.170255 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: from cryptography.utils import int_from_bytes Aug 19 21:07:18.170497 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 21:07:18.170497 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: from cryptography.utils import int_from_bytes Aug 19 21:07:18.170497 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 21:07:18.170497 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: from cryptography.utils import int_from_bytes Aug 19 21:07:20.644490 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 21:07:20.645226 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 21:07:20.645407 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 21:07:20.645661 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 21:07:20.645953 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 21:07:20.646337 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.646676 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.647007 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.647332 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.647676 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.647994 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.648326 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.648691 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.649950 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.649950 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.650224 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.650396 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-6-iscsi {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.650732 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.651052 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.651378 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.651706 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.652019 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.652351 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.652666 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.653180 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.653979 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.654297 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.654765 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.654962 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.655284 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.655607 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.655933 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.656256 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.656617 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.656890 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.657306 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-6-iscsi {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.657630 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.657984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.658306 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.658737 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.659056 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.659383 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.659696 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.660039 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.660348 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.660696 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.661022 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.661348 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.661677 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.662014 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.662329 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.662648 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.662975 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.663287 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.663600 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.664833 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.664833 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.665230 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.665581 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.665984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.665984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.666449 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.666645 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.666806 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.667124 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.667438 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.667751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.668065 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.668377 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.668690 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.669003 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.669317 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.669740 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.670005 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.670498 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.670828 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.671226 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.676622 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.676622 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.676622 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.676622 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.676622 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.676622 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.676622 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.676622 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.678557 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.678557 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.678557 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.678557 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.678557 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.678557 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.678557 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.678557 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.681231 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.681231 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.681231 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.681231 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.681231 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.681231 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.681231 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.681231 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.683055 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.683055 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.683055 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.683055 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.683055 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.683055 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.683055 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.683055 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.684477 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.684477 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.684477 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.684477 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.684477 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.685288 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.685496 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.685998 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.686821 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.687097 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.687419 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.688032 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.688801 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.689553 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.689858 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.690273 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.690671 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.691117 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.691352 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.691653 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.692074 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.692689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.692968 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.693299 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.693677 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.694170 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.694336 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.694667 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.695006 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.695333 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.695683 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.696000 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.696341 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.696698 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.697038 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.697394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.697723 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.698095 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.698441 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.698770 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.699093 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.699420 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.699757 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.700079 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.700400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.700720 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.701045 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.701381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.701723 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.702081 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.702407 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.702891 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.703135 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.703365 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.703707 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.704042 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.704364 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.704717 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.705074 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.705403 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.705739 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.706108 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.706433 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.706756 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.707075 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.707413 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.707759 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.708082 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.708412 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.708736 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.709059 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.709381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.709704 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.710057 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.710408 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.710733 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.711059 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.711580 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.711743 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.712065 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.712477 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.712687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.713126 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.713458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.713791 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.714109 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.714424 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.714761 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.715098 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.715423 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.715768 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.716081 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.716402 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.716721 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.717041 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.717400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.717675 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.718025 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.718345 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.718680 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.719002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.719314 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.719646 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.719961 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.720273 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.720599 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.720918 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.721237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.721581 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.721970 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.722320 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.722652 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.722974 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.723364 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.723664 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.723978 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.724313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.724651 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.724982 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.725348 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.725625 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.725989 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.729198 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.729198 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.729198 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.729198 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.729198 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.729198 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.729198 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.730210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.730210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.730210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.730570 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.730570 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.730933 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.731226 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.731545 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.731903 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.732252 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.732584 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.732918 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.733242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.733569 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.734003 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.734331 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.734657 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.734982 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.735312 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.735635 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.735971 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.736390 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.736654 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.737001 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.737294 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.737608 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.737973 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.738333 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.738683 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.739013 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.739344 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.739668 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.739995 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.740318 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.740639 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.740962 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.741284 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.741613 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.741969 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.742308 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.743377 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.743794 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.744118 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.744452 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.744768 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.745096 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.745440 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.745900 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.746145 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.746467 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.746801 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.747123 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.747443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.747759 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.748085 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.748400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.748721 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.749046 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.749365 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.749796 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.750113 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.750439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.750760 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.751079 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.751912 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.752094 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.752311 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.753541 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.753924 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.754268 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.754594 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.754916 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.755256 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.755584 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.755905 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.756360 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.756684 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.757051 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.757381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.757814 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.758097 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.758512 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.758805 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.759157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.759607 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.759878 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.760222 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.760553 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.760877 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.761203 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.761528 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.761879 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.762205 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.762545 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.762871 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.763196 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.763513 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.763830 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.764152 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.764483 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.765100 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.765451 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.765875 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.766225 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.766562 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.766893 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.767243 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.767587 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.767941 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.768263 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.768588 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.768906 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.769222 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.769545 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.769892 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.770204 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.770524 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.770861 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.771160 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.771475 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.771789 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.772111 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.772433 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.772746 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.773071 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.773389 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.773822 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.774342 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.774714 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.775035 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.775354 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.775722 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.776049 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.776405 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.776748 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.777108 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.777424 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.777740 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.778112 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.778428 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.778741 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.779055 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.779376 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.779695 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.780008 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.780329 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.780646 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.780964 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.781338 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.781597 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.781952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.782269 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.782601 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.782918 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.783230 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.783544 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.783865 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.784181 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.784494 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.784812 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.785122 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.785446 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.785803 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.786109 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.786424 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.786745 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.787065 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.787375 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.787715 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.788035 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.788350 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.788665 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.788984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.789891 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.790171 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.790492 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.790924 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.791156 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.791469 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.791791 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.792104 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.792418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.792731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.793055 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.793363 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.793676 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.794019 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.794333 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.794644 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.794980 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.795299 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.795613 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.795929 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.796242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.796607 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.796923 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.797289 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.797610 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.797964 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.798296 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.798623 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.798945 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.799269 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.799587 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.800061 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.800392 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.800715 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.801032 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.801346 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.801687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.802044 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.802365 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.802696 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.803031 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.803369 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.803674 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.803999 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.804323 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.804642 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.805622 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.806030 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.806322 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.806652 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.806973 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.807297 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.807620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.807935 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.808259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.808580 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.808895 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.809241 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.809567 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.809912 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.810236 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.810554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.810877 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.811194 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.811657 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.811982 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.812305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.812680 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.812950 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.813281 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.813595 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.814071 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.814392 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.814852 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.815177 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.815499 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.815821 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.816138 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.816458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.816779 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.817118 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.817433 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.817746 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.818098 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.818434 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.818751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.819083 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.819551 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.819873 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.820182 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.820644 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.820971 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.821293 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.821627 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.821990 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.822319 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.822639 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.822965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.823289 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.823624 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.823957 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.824281 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.824609 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.824923 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.825258 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.825590 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.825952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.826294 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.826740 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.827074 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.827397 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.827734 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.828073 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.828388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.828703 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.829027 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.829342 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.829655 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.830034 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.830350 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.830672 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.831023 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.831299 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.831618 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.831930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.832265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.832579 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.832912 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.833240 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.833573 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.833939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.834255 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.834586 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.834908 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.835224 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.835582 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.835852 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.836514 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.836631 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.836879 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.837220 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.837559 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.837904 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.838251 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.838586 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.838913 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.839241 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.839575 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.839890 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.840201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.840520 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.840832 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.841144 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.841456 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.841848 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.842116 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.842428 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.842738 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.843075 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.843388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.843720 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.844040 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.844352 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.844666 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.844980 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.845335 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.845649 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.846027 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.846350 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.846720 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.847007 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.847336 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.847660 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.847984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.848312 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.848637 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.848958 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.849277 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.849599 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.849964 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.850283 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.850867 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.851204 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.851530 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.852389 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.852713 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.853036 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.853362 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.853833 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.854149 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.854470 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.854789 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.855126 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.855457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.855794 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.856142 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.856478 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.856804 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.857128 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.857452 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.857852 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.858181 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.858497 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.858822 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.859148 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.859471 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.859791 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.860114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.860434 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.860755 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.861076 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.861395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.861715 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.862137 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.862477 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.862825 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.863161 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.863487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.863810 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.864138 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.864719 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.865048 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.865426 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.865739 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.866112 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.866447 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.866780 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.867125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.867550 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.868557 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.868903 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.869226 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.869543 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.869909 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.870240 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.870554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.870888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.871211 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.871323 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 21:07:20.871749 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 21:07:20.871829 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.872144 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.872473 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.872568 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 21:07:20.872820 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.873116 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 21:07:20.873217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.873519 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.873618 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 21:07:20.873862 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.874202 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.874314 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.874520 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.874753 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.874849 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.875154 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.875306 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.875492 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.875793 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.875898 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.876117 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.876651 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.876748 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.877016 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.877188 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.877390 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.877642 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.877837 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.877998 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.878288 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.878458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.878601 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.878855 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.879014 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.879227 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.879390 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.879543 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.879832 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.879997 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.880141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.880449 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.880631 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-6-iscsi {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.880787 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.881074 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.881252 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.881406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.881693 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.882006 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.882164 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.882345 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.882638 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.882799 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.882967 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.883242 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.883397 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.883626 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.883770 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.883953 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.884283 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.884451 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.884645 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.884807 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.884965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.885288 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.885616 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.885850 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.886046 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.886316 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.886472 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.886637 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.886829 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.887240 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.887413 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.887565 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.887899 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.888058 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.888247 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.888432 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.888583 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.888896 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.889053 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.889195 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.889615 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.889867 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.889867 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.890158 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.890310 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.890480 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.890626 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.890781 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.891260 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.891421 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.891421 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.891735 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.891900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-6-iscsi {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.892061 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.892214 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.892356 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.892697 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.892935 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.893082 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.893223 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.893363 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.893535 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.893899 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.894075 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.894219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.894426 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.894576 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.894848 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.895003 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.895164 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.895438 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.895610 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.895893 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.896047 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.896189 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.896371 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.896526 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.896787 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.896948 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.897090 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.897271 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.897421 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.897645 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.897905 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.898081 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.898322 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.898488 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.898658 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.898952 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.899170 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.899454 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.899611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.899813 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.900004 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.900148 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.900905 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.901098 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.901282 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.901445 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.901588 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.901588 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.901965 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.902107 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.902339 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.902483 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.902483 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.902804 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.902950 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.902950 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.903237 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.903387 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.903529 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.903681 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.904333 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.904507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.904656 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.904797 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.904961 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.904961 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.905239 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.905391 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.905391 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.905691 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.905878 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.906043 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.906202 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.906345 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.906511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.907084 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.907084 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.907368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.907530 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.907530 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.907805 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.907947 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.908087 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.908245 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.908396 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.908584 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.908734 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.908963 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.909119 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.909270 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.909579 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.909731 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.909950 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.910147 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.910304 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.910521 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.910681 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.910823 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.911127 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.911275 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.911475 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.911739 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.911887 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.912124 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.912271 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.912455 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.912693 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.912853 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.913090 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.913417 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.913607 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.913783 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.913945 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.915381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.915566 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.915712 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.915712 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.915986 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.916142 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.916142 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.916417 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.916572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.916572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.917329 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.917495 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.917495 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.917815 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.917965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.917965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.918245 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.918397 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.918538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.918680 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.918820 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.918971 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.919119 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.919408 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.919556 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.919763 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.919975 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.920123 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.920355 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.920550 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.920707 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.920975 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.921121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.921295 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.921501 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.921656 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.921945 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.922104 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.922270 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.922585 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.922742 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.922903 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.923142 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.923298 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.923519 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.923674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.923856 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.924202 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.924564 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.924722 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.924865 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.925038 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.925542 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.925701 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.925890 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.926036 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.926186 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.926186 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.926465 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.926618 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.926801 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.926978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.928194 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.928362 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.928507 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.928507 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 21:07:20.928791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.928791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.929081 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.929412 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.930924 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.931666 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.932246 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.932782 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.933321 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.933884 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.934425 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.934991 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.935648 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.936065 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.936629 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.937141 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.937649 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.938297 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.938709 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.939229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.939819 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.940271 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.940782 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.941340 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.941961 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.942488 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.943021 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.943886 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.944128 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.944643 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.945135 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.945685 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.946522 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.947248 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.947961 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.948230 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.948714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.949188 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.949681 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 21:07:20.950378 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.950890 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.951412 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.951907 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.952464 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.953029 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.953733 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.954295 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.954865 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.955601 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.956259 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.956714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.957262 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.958109 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.958502 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.959265 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.959846 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.960409 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.960977 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.961560 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.962318 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.962892 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.963470 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.964033 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.964648 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.965298 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.965835 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.966442 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.967022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.967595 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.968270 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.968708 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.969299 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.969953 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.970525 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.971120 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.971718 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.972308 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.972864 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.973452 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.974035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.974685 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.975238 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.975816 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.976368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.978290 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.978755 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.979347 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.979922 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.980515 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.981101 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.981686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.982301 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.982879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.983483 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.984105 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.984668 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.985265 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.985808 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.986409 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.986964 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.987534 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.988156 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.988801 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.989462 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.989982 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.990610 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.991170 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.991803 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.993976 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.993976 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.994350 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.994773 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.995200 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.995634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.996065 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.996494 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.997014 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.997437 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.998434 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.998652 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.999048 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.999502 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:20.999968 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.000427 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.000882 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.001591 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.002100 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.002551 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.003002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.003450 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.003905 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.004429 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.004884 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.005324 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.005807 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.006249 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.006739 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.007260 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.007720 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.008361 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.009400 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.010067 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.010605 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.011275 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.011726 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.012279 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.012737 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.013278 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.013916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.014474 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.014933 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.015440 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.016005 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.016534 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.016986 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.017616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.018085 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.018705 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.019242 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.019716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.020167 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.020632 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.021157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.021711 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.022300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.022856 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.023312 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.036779 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.036779 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.036779 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.036779 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.036779 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.036779 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.036779 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.036779 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.038676 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.038676 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.038676 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.038676 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.038676 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.038676 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.038676 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.038676 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.041627 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.041627 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.041627 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.041627 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.041627 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.041627 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.041627 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.041627 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.043422 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.043422 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.043422 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.043422 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.043422 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.043422 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.043422 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.043422 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.045037 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.045037 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.045037 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.045037 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.045037 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.046099 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.046099 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.046509 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.047160 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.047743 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.048311 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.048815 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.049287 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.049818 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.050415 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.050866 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.052188 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.052188 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.052623 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.053017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.053695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.054054 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.054537 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.055080 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.055539 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.055997 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.056446 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.056905 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.057602 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.058491 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.058781 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.059240 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.059700 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.060145 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.060602 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.061063 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.061865 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.062409 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.062942 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.063367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.063890 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.064344 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.064834 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.065301 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.065945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.066412 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.066897 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.068831 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.068831 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.068831 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.069532 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.069902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.070346 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.070784 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.071323 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.071713 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.072081 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.072505 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.072888 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.073306 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.073867 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.074359 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.074835 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.075360 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.075802 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.076249 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.076843 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.077271 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.077716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.078275 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.078811 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.079310 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.079759 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.080222 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.080627 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.081009 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.081428 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.081854 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.082374 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.082870 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.083311 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.083772 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.084282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.084795 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.085286 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.085937 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.086824 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.087305 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.087797 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.088296 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.088817 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.089350 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.089972 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.090821 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.091396 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.091808 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO dbcounter [None req-84be324f-cac9-4adb-8644-d5ff2bbad65c None None] Registered counter for database nova_api Aug 19 21:07:21.093102 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.093639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.094249 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.095184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.095344 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.095836 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.096368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.096920 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.097462 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.098060 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.098615 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.099174 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.099697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.100227 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.100724 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.101159 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.101691 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.102729 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.103304 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.103679 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.104207 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.104599 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.104990 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.105446 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.105950 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.106390 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.106821 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.107245 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.107669 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.108089 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.108537 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.108957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.110055 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.110457 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.111015 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.111598 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.112115 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.112680 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.113228 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.113867 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.114443 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.114943 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.115443 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.115917 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.116436 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.116881 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.117102 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_db.sqlalchemy.engines [None req-84be324f-cac9-4adb-8644-d5ff2bbad65c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 21:07:21.117318 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.118151 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.118366 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.118765 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.119165 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.119564 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.120072 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.120546 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.121242 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.121844 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.122291 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.122955 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.123536 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.123913 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.124287 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.124656 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.125029 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.125402 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.125792 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.126436 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.126889 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.127257 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.127644 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.127997 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.128359 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.128531 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writer thread running {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 21:07:21.128788 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.129737 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.129737 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.130165 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.130546 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.130941 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.131390 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.132156 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.132978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.132978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.133241 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.133605 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.134035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.134450 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.134823 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.135203 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.135717 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.136104 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.136490 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.136960 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.137342 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.137719 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.138134 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.138545 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.138949 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.139374 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.139750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.140202 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.140583 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.140987 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.141572 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.142129 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.142603 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.143250 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.143722 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.144153 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.144735 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.145120 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.145526 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.146061 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.146500 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.146907 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.147454 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.147828 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.148264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.149347 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.150018 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.150901 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.151344 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.151834 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.152406 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.153016 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.153582 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.154094 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.154576 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.155127 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.155573 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.156065 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.156545 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.156942 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.157511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.158031 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.158477 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.158944 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.159339 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.159861 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.160247 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.160682 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.161085 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.161470 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.161918 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.162315 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.162887 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.163157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.163603 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.163997 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.164431 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.169839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.169839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.169839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.169839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.169839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.169839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.169839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.169839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.171057 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.171057 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.171057 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.171057 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.171057 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.171057 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.171920 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.171920 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.172273 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.172778 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.173323 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.173893 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.174302 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.174697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.175078 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.175472 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.175946 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.176364 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.176812 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.177237 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.177665 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.178128 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.178510 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.179035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.179480 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.180550 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.181175 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.181594 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.182048 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.182446 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.182848 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.183307 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.183818 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.184330 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.184760 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.185192 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.185620 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.186096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.186528 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.187318 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.187839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.188344 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.188839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.189266 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.189693 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.190147 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.190634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.191060 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.191496 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.191955 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.192452 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.192865 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.193337 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.193877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.194413 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.194893 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.195371 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.196443 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.196851 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.197244 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.197629 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.198145 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.198599 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.199096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.199557 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.200054 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.200517 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.200993 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.201466 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.201964 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.202392 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.202858 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.203303 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.203842 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.204379 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.204898 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.205322 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.205754 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.206452 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.206875 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.207326 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.207760 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.208350 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.208690 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.209120 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.209564 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.210072 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.210486 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.210907 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.211924 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.212419 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.212865 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.213110 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.context [None req-84be324f-cac9-4adb-8644-d5ff2bbad65c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fc0b118c-f5c7-41ee-a2c7-c718014c8ac6(cell1) {{(pid=120877) load_cells /opt/stack/nova/nova/context.py:464}} Aug 19 21:07:21.213398 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.213946 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.214458 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.214864 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.215589 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.216011 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.216408 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.216830 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.217234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.217523 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-84be324f-cac9-4adb-8644-d5ff2bbad65c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:07:21.217729 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.218094 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.218283 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-84be324f-cac9-4adb-8644-d5ff2bbad65c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:07:21.218579 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.218987 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.219463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.219814 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-84be324f-cac9-4adb-8644-d5ff2bbad65c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:07:21.219996 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.220281 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.220608 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-84be324f-cac9-4adb-8644-d5ff2bbad65c None None] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:07:21.220786 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.221073 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-84be324f-cac9-4adb-8644-d5ff2bbad65c None None] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:07:21.221242 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.221504 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.221934 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.222385 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.222849 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.223191 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-84be324f-cac9-4adb-8644-d5ff2bbad65c None None] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:07:21.223370 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.223822 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.224333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.224826 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.225298 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.225547 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO dbcounter [None req-84be324f-cac9-4adb-8644-d5ff2bbad65c None None] Registered counter for database nova_cell0 Aug 19 21:07:21.225749 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.226166 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.226545 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.227483 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.227863 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.228253 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.228902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.229294 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.229671 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.230097 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.230485 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.230665 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO dbcounter [None req-84be324f-cac9-4adb-8644-d5ff2bbad65c None None] Registered counter for database nova_cell1 Aug 19 21:07:21.230911 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.231290 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.231692 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.232069 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.232576 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.232996 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.233451 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.234121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.234648 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.235152 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.235929 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.236259 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.236948 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.237390 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.237854 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.238403 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.238931 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.239464 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.240005 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.240419 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_db.sqlalchemy.engines [None req-84be324f-cac9-4adb-8644-d5ff2bbad65c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 21:07:21.240548 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.241077 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.241575 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.242034 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.242466 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.243525 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_db.sqlalchemy.engines [None req-84be324f-cac9-4adb-8644-d5ff2bbad65c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 21:07:21.243696 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.244123 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.245021 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.245021 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.245559 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.246155 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.246557 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.247097 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.247536 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.248013 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.248458 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.248842 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.249260 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.249709 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writer thread running {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 21:07:21.249984 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.250304 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.250809 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.251554 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.251985 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.252413 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.252861 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writer thread running {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 21:07:21.253123 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.253596 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.253947 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.254476 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.254976 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.255395 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.256013 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.256474 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.256905 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.257343 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.257798 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.259566 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.260028 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.260455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.261003 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.261505 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.261994 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.262510 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.262955 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.263400 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.263865 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.264313 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.264824 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.265349 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.265864 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.266286 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.266723 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.267105 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.267491 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.267875 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.268254 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.268634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.269011 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.269393 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.269781 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.270184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.270600 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.270979 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.271360 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.271737 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.272120 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.272547 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.272927 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.273303 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.273968 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.274457 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.275114 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.275575 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.275970 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.276513 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.276973 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.277383 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.277912 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.278322 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.278726 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.279116 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.279579 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.280052 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.280509 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.280963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.281422 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.281919 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.282378 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.282839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.283314 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.283779 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.284234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.284711 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.285217 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.285721 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.286291 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.286678 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.287156 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.287530 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.287902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.288269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.288641 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.289010 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.289429 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.289974 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.290352 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.290748 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.291140 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.291540 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.291944 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.292332 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.292735 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.293309 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.294015 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.294573 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.295032 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.295662 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.296096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.296611 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.297100 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 21:07:21.297466 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 21:07:21.364992 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO dbcounter [None req-2abba6b3-e3f5-469b-a7e3-3ed6b6ba956b None None] Registered counter for database nova_api Aug 19 21:07:21.389715 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_db.sqlalchemy.engines [None req-2abba6b3-e3f5-469b-a7e3-3ed6b6ba956b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 21:07:21.398403 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writer thread running {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 21:07:21.410507 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO dbcounter [None req-84be324f-cac9-4adb-8644-d5ff2bbad65c None None] Registered counter for database nova_cell0 Aug 19 21:07:21.420443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_db.sqlalchemy.engines [None req-84be324f-cac9-4adb-8644-d5ff2bbad65c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 21:07:21.426613 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writer thread running {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 21:07:21.469994 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.context [None req-2abba6b3-e3f5-469b-a7e3-3ed6b6ba956b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fc0b118c-f5c7-41ee-a2c7-c718014c8ac6(cell1) {{(pid=120876) load_cells /opt/stack/nova/nova/context.py:464}} Aug 19 21:07:21.474257 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2abba6b3-e3f5-469b-a7e3-3ed6b6ba956b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:07:21.474797 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2abba6b3-e3f5-469b-a7e3-3ed6b6ba956b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:07:21.476665 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2abba6b3-e3f5-469b-a7e3-3ed6b6ba956b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:07:21.479498 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2abba6b3-e3f5-469b-a7e3-3ed6b6ba956b None None] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:07:21.479498 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2abba6b3-e3f5-469b-a7e3-3ed6b6ba956b None None] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:07:21.481823 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2abba6b3-e3f5-469b-a7e3-3ed6b6ba956b None None] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:07:21.484036 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO dbcounter [None req-2abba6b3-e3f5-469b-a7e3-3ed6b6ba956b None None] Registered counter for database nova_cell0 Aug 19 21:07:21.489011 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO dbcounter [None req-2abba6b3-e3f5-469b-a7e3-3ed6b6ba956b None None] Registered counter for database nova_cell1 Aug 19 21:07:21.503134 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_db.sqlalchemy.engines [None req-2abba6b3-e3f5-469b-a7e3-3ed6b6ba956b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 21:07:21.505241 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_db.sqlalchemy.engines [None req-2abba6b3-e3f5-469b-a7e3-3ed6b6ba956b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 21:07:21.516425 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writer thread running {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 21:07:21.678990 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writer thread running {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 21:07:21.697724 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO dbcounter [None req-2abba6b3-e3f5-469b-a7e3-3ed6b6ba956b None None] Registered counter for database nova_cell0 Aug 19 21:07:21.709180 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_db.sqlalchemy.engines [None req-2abba6b3-e3f5-469b-a7e3-3ed6b6ba956b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 21:07:21.719698 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writer thread running {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 21:07:21.788372 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: WARNING keystonemiddleware.auth_token [None req-84be324f-cac9-4adb-8644-d5ff2bbad65c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 21:07:21.796344 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: WARNING keystonemiddleware.auth_token [None req-84be324f-cac9-4adb-8644-d5ff2bbad65c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 21:07:22.078115 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: WARNING keystonemiddleware.auth_token [None req-2abba6b3-e3f5-469b-a7e3-3ed6b6ba956b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 21:07:22.086710 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: WARNING keystonemiddleware.auth_token [None req-2abba6b3-e3f5-469b-a7e3-3ed6b6ba956b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 21:07:22.156292 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: WARNING keystonemiddleware.auth_token [None req-84be324f-cac9-4adb-8644-d5ff2bbad65c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 21:07:22.162773 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: WARNING keystonemiddleware.auth_token [None req-84be324f-cac9-4adb-8644-d5ff2bbad65c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 21:07:22.174639 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559cd41539c0 pid: 120877 (default app) Aug 19 21:07:22.452722 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: WARNING keystonemiddleware.auth_token [None req-2abba6b3-e3f5-469b-a7e3-3ed6b6ba956b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 21:07:22.459188 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: WARNING keystonemiddleware.auth_token [None req-2abba6b3-e3f5-469b-a7e3-3ed6b6ba956b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 21:07:22.465299 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559cd41539c0 pid: 120876 (default app) Aug 19 21:08:04.270335 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=3 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:04.271651 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=3 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:04.273657 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=3 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:04.277791 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=3 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:05.602533 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=3 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:05.604094 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=3 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:05.610023 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=3 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:05.617202 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=3 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:06.532798 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-51c8a1b0-7989-47ec-9757-8ff8ffcc238a tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] Action: 'create', calling method: .version_select at 0x7f7419d595e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-136682323", "metadata": {"Type": "work"}}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:08:07.423832 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-5be3c834-665e-45e6-a7dc-aa49f8907f35 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Action: 'create', calling method: .version_select at 0x7f7419d9d700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1168007962"}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:08:08.456352 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-51c8a1b0-7989-47ec-9757-8ff8ffcc238a tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.207142 Aug 19 21:08:08.458152 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Aug 19 21:08:04 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4212 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 19 21:08:08.506049 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-83d1da50-8a40-4a3f-a276-1190600ff187 tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] Calling method '.version_select at 0x7f7419baf4c0>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:08.624835 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-83d1da50-8a40-4a3f-a276-1190600ff187 tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/275b932c-e7c9-46c3-825b-4869e8b7b235" status: 200 len: 352 microversion: 2.1 time: 0.153039 Aug 19 21:08:08.625413 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 2/2] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Aug 19 21:08:08 2022] GET /compute/v2.1/os-volumes/275b932c-e7c9-46c3-825b-4869e8b7b235 => generated 352 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:08:09.215241 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-5be3c834-665e-45e6-a7dc-aa49f8907f35 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.642798 Aug 19 21:08:09.217126 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1155 bytes} [Fri Aug 19 21:08:05 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3649 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 19 21:08:09.255708 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-6839607d-e72e-4e1d-b402-1f949fe04380 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Calling method '.version_select at 0x7f7419bafb80>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:09.404830 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-6839607d-e72e-4e1d-b402-1f949fe04380 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/2a78265d-3ef3-48c8-8006-cda964ee004c" status: 200 len: 345 microversion: 2.1 time: 0.162636 Aug 19 21:08:09.417732 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 3/4] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Aug 19 21:08:09 2022] GET /compute/v2.1/os-volumes/2a78265d-3ef3-48c8-8006-cda964ee004c => generated 345 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:08:09.643412 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-0e3afee6-1747-48e2-9379-96f9a3ea0092 tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] Calling method '.version_select at 0x7f7419bf9550>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:09.721802 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-0e3afee6-1747-48e2-9379-96f9a3ea0092 tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/275b932c-e7c9-46c3-825b-4869e8b7b235" status: 200 len: 352 microversion: 2.1 time: 0.083731 Aug 19 21:08:09.729920 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 2/5] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Aug 19 21:08:09 2022] GET /compute/v2.1/os-volumes/275b932c-e7c9-46c3-825b-4869e8b7b235 => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:08:10.455225 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a9e08279-c858-4460-8a88-0fa8ced7f236 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Calling method '.version_select at 0x7f7419bc8310>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:10.609217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-a9e08279-c858-4460-8a88-0fa8ced7f236 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/2a78265d-3ef3-48c8-8006-cda964ee004c" status: 200 len: 346 microversion: 2.1 time: 0.184393 Aug 19 21:08:10.611524 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 4/6] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Aug 19 21:08:10 2022] GET /compute/v2.1/os-volumes/2a78265d-3ef3-48c8-8006-cda964ee004c => generated 346 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:08:10.635148 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-cc3eb891-3821-44a9-bfd9-6bf7788f54c0 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Action: 'create', calling method: .version_select at 0x7f7419bf9ca0>, body: {"snapshot": {"volume_id": "2a78265d-3ef3-48c8-8006-cda964ee004c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1102872144"}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:08:10.745084 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8e506701-7911-413d-b0b2-1489b0e81ca2 tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] Calling method '.version_select at 0x7f7419bafd30>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:10.981405 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8e506701-7911-413d-b0b2-1489b0e81ca2 tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/275b932c-e7c9-46c3-825b-4869e8b7b235" status: 200 len: 353 microversion: 2.1 time: 0.246550 Aug 19 21:08:10.983201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 5/7] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Aug 19 21:08:10 2022] GET /compute/v2.1/os-volumes/275b932c-e7c9-46c3-825b-4869e8b7b235 => generated 353 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:08:11.029689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-b98eb487-2620-46f1-9d9e-096d50299540 tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] Calling method '.version_select at 0x7f7419baf670>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:11.246631 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-b98eb487-2620-46f1-9d9e-096d50299540 tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/275b932c-e7c9-46c3-825b-4869e8b7b235" status: 200 len: 353 microversion: 2.1 time: 0.250558 Aug 19 21:08:11.247653 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 6/8] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Aug 19 21:08:10 2022] GET /compute/v2.1/os-volumes/275b932c-e7c9-46c3-825b-4869e8b7b235 => generated 353 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:08:11.271371 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-11883187-fec2-44ac-9e95-52d7c0002628 tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] Calling method '.version_select at 0x7f7419bc84c0>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:11.411021 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-cc3eb891-3821-44a9-bfd9-6bf7788f54c0 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.783844 Aug 19 21:08:11.432594 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 3/9] 10.222.0.16 () {60 vars in 1162 bytes} [Fri Aug 19 21:08:10 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:08:11.462816 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-9ee277c4-2def-4a6e-9aa0-1b79893b2c21 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Calling method '.version_select at 0x7f7419c0edc0>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:11.569482 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-9ee277c4-2def-4a6e-9aa0-1b79893b2c21 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/882d1f30-1e20-4852-afba-1c0c2b9ce063" status: 200 len: 287 microversion: 2.1 time: 0.130487 Aug 19 21:08:11.571907 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 4/10] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Aug 19 21:08:11 2022] GET /compute/v2.1/os-snapshots/882d1f30-1e20-4852-afba-1c0c2b9ce063 => generated 287 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:08:11.593351 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-ce949909-096a-4f5d-8073-c096b68597c1 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Calling method '.version_select at 0x7f7419c0e4c0>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:11.607651 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-11883187-fec2-44ac-9e95-52d7c0002628 tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/275b932c-e7c9-46c3-825b-4869e8b7b235" status: 202 len: 0 microversion: 2.1 time: 0.344361 Aug 19 21:08:11.609102 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 7/11] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Aug 19 21:08:11 2022] DELETE /compute/v2.1/os-volumes/275b932c-e7c9-46c3-825b-4869e8b7b235 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:08:11.625130 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ee88c14e-e7e5-47ce-b684-39743d0eabf6 tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] Calling method '.version_select at 0x7f7419baf430>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:12.020592 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-ce949909-096a-4f5d-8073-c096b68597c1 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.181354 Aug 19 21:08:12.020592 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 5/12] 10.222.0.16 () {58 vars in 1140 bytes} [Fri Aug 19 21:08:11 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:08:12.023051 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ee88c14e-e7e5-47ce-b684-39743d0eabf6 tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/275b932c-e7c9-46c3-825b-4869e8b7b235" status: 200 len: 352 microversion: 2.1 time: 0.170921 Aug 19 21:08:12.023051 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 8/13] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Aug 19 21:08:11 2022] GET /compute/v2.1/os-volumes/275b932c-e7c9-46c3-825b-4869e8b7b235 => generated 352 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:08:12.024560 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-35486add-cf1f-4cd9-b86a-fbbeb61e491f tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Calling method '.version_select at 0x7f7419bf99d0>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:12.024560 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-35486add-cf1f-4cd9-b86a-fbbeb61e491f tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/882d1f30-1e20-4852-afba-1c0c2b9ce063" status: 200 len: 287 microversion: 2.1 time: 0.049562 Aug 19 21:08:12.024560 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 6/14] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Aug 19 21:08:11 2022] GET /compute/v2.1/os-snapshots/882d1f30-1e20-4852-afba-1c0c2b9ce063 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:08:12.802230 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-fc8b9aa9-6337-46ca-bdda-7bec03fa716a tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] Calling method '.version_select at 0x7f7419bafaf0>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:12.859552 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-5b2e9772-484e-48d9-a698-ffd7323f13c1 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Calling method '.version_select at 0x7f7419bf93a0>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:12.919819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-fc8b9aa9-6337-46ca-bdda-7bec03fa716a tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/275b932c-e7c9-46c3-825b-4869e8b7b235" status: 200 len: 352 microversion: 2.1 time: 0.121791 Aug 19 21:08:12.920573 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 9/15] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Aug 19 21:08:12 2022] GET /compute/v2.1/os-volumes/275b932c-e7c9-46c3-825b-4869e8b7b235 => generated 352 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:08:12.934561 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-5b2e9772-484e-48d9-a698-ffd7323f13c1 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/882d1f30-1e20-4852-afba-1c0c2b9ce063" status: 200 len: 287 microversion: 2.1 time: 0.083601 Aug 19 21:08:12.935196 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 7/16] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Aug 19 21:08:12 2022] GET /compute/v2.1/os-snapshots/882d1f30-1e20-4852-afba-1c0c2b9ce063 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:08:13.936878 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-59ae7c76-878d-4d3c-81f4-38246067ff62 tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] Calling method '.version_select at 0x7f7419bc80d0>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:13.951169 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-7efe728a-60e7-4e6c-9c63-d678d60a80f8 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Calling method '.version_select at 0x7f7419bf9b80>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:14.019705 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-7efe728a-60e7-4e6c-9c63-d678d60a80f8 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/882d1f30-1e20-4852-afba-1c0c2b9ce063" status: 200 len: 287 microversion: 2.1 time: 0.071977 Aug 19 21:08:14.022118 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 8/17] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Aug 19 21:08:13 2022] GET /compute/v2.1/os-snapshots/882d1f30-1e20-4852-afba-1c0c2b9ce063 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:08:14.142351 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-59ae7c76-878d-4d3c-81f4-38246067ff62 tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/275b932c-e7c9-46c3-825b-4869e8b7b235" status: 200 len: 352 microversion: 2.1 time: 0.210994 Aug 19 21:08:14.143511 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 10/18] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Aug 19 21:08:13 2022] GET /compute/v2.1/os-volumes/275b932c-e7c9-46c3-825b-4869e8b7b235 => generated 352 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:08:15.035252 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-2c671fa5-ffaa-4dba-bda2-37a8c150954b tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Calling method '.version_select at 0x7f741a5cfa60>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:15.180045 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-00a53755-764b-464a-9365-0d9efe1c0ade tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] Calling method '.version_select at 0x7f7419bafdc0>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:15.237519 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-2c671fa5-ffaa-4dba-bda2-37a8c150954b tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/882d1f30-1e20-4852-afba-1c0c2b9ce063" status: 200 len: 287 microversion: 2.1 time: 0.206323 Aug 19 21:08:15.238153 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 9/19] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Aug 19 21:08:15 2022] GET /compute/v2.1/os-snapshots/882d1f30-1e20-4852-afba-1c0c2b9ce063 => generated 287 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:08:15.409679 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-00a53755-764b-464a-9365-0d9efe1c0ade tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/275b932c-e7c9-46c3-825b-4869e8b7b235" status: 200 len: 352 microversion: 2.1 time: 0.253773 Aug 19 21:08:15.420167 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 11/20] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Aug 19 21:08:15 2022] GET /compute/v2.1/os-volumes/275b932c-e7c9-46c3-825b-4869e8b7b235 => generated 352 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:08:16.260682 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-b24eacf4-7b53-414a-917f-ab75803b70d2 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Calling method '.version_select at 0x7f7419baf700>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:16.324311 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-b24eacf4-7b53-414a-917f-ab75803b70d2 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/882d1f30-1e20-4852-afba-1c0c2b9ce063" status: 200 len: 287 microversion: 2.1 time: 0.069307 Aug 19 21:08:16.324958 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 12/21] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Aug 19 21:08:16 2022] GET /compute/v2.1/os-snapshots/882d1f30-1e20-4852-afba-1c0c2b9ce063 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:08:16.431521 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e452db26-684f-4c59-93fb-bd5acd0becad tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] Calling method '.version_select at 0x7f7419bc8040>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:16.546855 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-0bbdf8e1-8ed8-4339-966e-57ae9a345826 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-235653718", "imageRef": "d1f034cf-f103-477b-bbb5-3298c678db05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:08:16.610574 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e452db26-684f-4c59-93fb-bd5acd0becad tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/275b932c-e7c9-46c3-825b-4869e8b7b235" status: 200 len: 352 microversion: 2.1 time: 0.185769 Aug 19 21:08:16.611435 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 13/22] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Aug 19 21:08:16 2022] GET /compute/v2.1/os-volumes/275b932c-e7c9-46c3-825b-4869e8b7b235 => generated 352 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:08:16.809037 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.network.neutron [None req-0bbdf8e1-8ed8-4339-966e-57ae9a345826 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] validate_networks() for [('191d091b-fd3f-485e-a729-86fc2a15707b', None, None, None, None, None)] {{(pid=120876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 21:08:17.338481 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-9870af5b-88bc-4944-a3b0-11e35220f82a tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Calling method '.version_select at 0x7f7419bc8c10>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:17.454389 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-9870af5b-88bc-4944-a3b0-11e35220f82a tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/882d1f30-1e20-4852-afba-1c0c2b9ce063" status: 200 len: 287 microversion: 2.1 time: 0.121408 Aug 19 21:08:17.455570 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 14/23] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Aug 19 21:08:17 2022] GET /compute/v2.1/os-snapshots/882d1f30-1e20-4852-afba-1c0c2b9ce063 => generated 287 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:08:17.629855 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-f6c66999-2e0c-40c7-9c8a-f585b66df446 tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] Calling method '.version_select at 0x7f7419bc8b80>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:18.134686 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-f6c66999-2e0c-40c7-9c8a-f585b66df446 tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] HTTP exception thrown: Volume 275b932c-e7c9-46c3-825b-4869e8b7b235 could not be found. Aug 19 21:08:18.143219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-f6c66999-2e0c-40c7-9c8a-f585b66df446 tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] Request method failure captured: Aug 19 21:08:18.143219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: GET /compute/v2.1/os-volumes/275b932c-e7c9-46c3-825b-4869e8b7b235 HTTP/1.1 Aug 19 21:08:18.143219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:08:18.143219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:08:18.143219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:08:18.143219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:08:18.143219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:08:18.143219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:08:18.143219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:08:18.143219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:08:18.143219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__u0MRC5jxYkb8tyUZUr5dYn3nUZIAW_LcafkHDwDkY34Mn_udKg4H0HFlW6KFxgFNdxSm-sfKpSI6TaLJ1-GvAlgETP-rs0HyMkrpNkdopj5nFrs6KhuKKbSHpDxirdqSYW9Wp-yOp1NpyYItHoN5QfrdRN7DHnHq2KDbK1v6Sw2Dw Aug 19 21:08:18.143219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:08:18.143219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:08:18.143219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:08:18.143219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:08:18.143219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:08:18.143219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:08:18.143219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: 6f7cafd832804f8bab8322ee27c1803d Aug 19 21:08:18.143219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-VolumesGetTestJSON-1883641346 Aug 19 21:08:18.143219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:08:18.143219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:08:18.144519 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6f7cafd832804f8bab8322ee27c1803d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f7cafd832804f8bab8322ee27c1803d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6f7cafd832804f8bab8322ee27c1803d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f7cafd832804f8bab8322ee27c1803d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:08:18.144519 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-VolumesGetTestJSON-1883641346 Aug 19 21:08:18.144519 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: 6f7cafd832804f8bab8322ee27c1803d Aug 19 21:08:18.144519 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-VolumesGetTestJSON-1883641346 Aug 19 21:08:18.144519 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-VolumesGetTestJSON-1883641346-project Aug 19 21:08:18.144519 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:08:18.144519 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:08:18.144519 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: 629d7d6f348d4805bd10850d151daefb Aug 19 21:08:18.144519 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-VolumesGetTestJSON-1883641346-project Aug 19 21:08:18.144519 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: Aug 19 21:08:18.144519 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Volume 275b932c-e7c9-46c3-825b-4869e8b7b235 could not be found. Aug 19 21:08:18.144519 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'id': '275b932c-e7c9-46c3-825b-4869e8b7b235'} Aug 19 21:08:18.144519 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:08:18.145313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:08:18.145313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 21:08:18.145313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 21:08:18.145313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 19 21:08:18.145313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 19 21:08:18.145313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 19 21:08:18.145313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 19 21:08:18.145313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 21:08:18.145313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 21:08:18.145313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 21:08:18.145313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 21:08:18.145313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 21:08:18.145313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 21:08:18.145313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 21:08:18.145313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 21:08:18.145313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 275b932c-e7c9-46c3-825b-4869e8b7b235 could not be found. (HTTP 404) (Request-ID: req-690c584f-b43d-4332-9208-1e45b2b0f3b5) Aug 19 21:08:18.145313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:08:18.145313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:08:18.145313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:08:18.146400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:08:18.146400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 19 21:08:18.146400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 19 21:08:18.146400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 19 21:08:18.146400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 19 21:08:18.146400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 19 21:08:18.146400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 19 21:08:18.146400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 19 21:08:18.146400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 19 21:08:18.146400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 21:08:18.146400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 21:08:18.146400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 19 21:08:18.146400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 19 21:08:18.146400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 19 21:08:18.146400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 19 21:08:18.146400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 21:08:18.146400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 21:08:18.146400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 21:08:18.146400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 21:08:18.149157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 21:08:18.149157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 21:08:18.149157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 21:08:18.149157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 21:08:18.149157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 275b932c-e7c9-46c3-825b-4869e8b7b235 could not be found. Aug 19 21:08:18.149157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:08:18.149157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:08:18.149157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:08:18.149157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:08:18.149157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:08:18.149157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:08:18.149157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:08:18.149157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:08:18.149157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 21:08:18.149157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 21:08:18.149157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:08:18.149157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:08:18.149157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 19 21:08:18.149157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:08:18.151686 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 275b932c-e7c9-46c3-825b-4869e8b7b235 could not be found. Aug 19 21:08:18.151686 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:08:18.151686 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:08:18.151686 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:08:18.151686 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:08:18.151686 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:08:18.151686 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:08:18.151686 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:08:18.151686 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:08:18.151686 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 275b932c-e7c9-46c3-825b-4869e8b7b235 could not be found. Aug 19 21:08:18.151686 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:08:18.154665 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-f6c66999-2e0c-40c7-9c8a-f585b66df446 tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] Returning 404 to user: Volume 275b932c-e7c9-46c3-825b-4869e8b7b235 could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:08:18.155845 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-f6c66999-2e0c-40c7-9c8a-f585b66df446 tempest-VolumesGetTestJSON-1883641346 tempest-VolumesGetTestJSON-1883641346-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/275b932c-e7c9-46c3-825b-4869e8b7b235" status: 404 len: 109 microversion: 2.1 time: 0.530446 Aug 19 21:08:18.164061 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 15/24] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Aug 19 21:08:17 2022] GET /compute/v2.1/os-volumes/275b932c-e7c9-46c3-825b-4869e8b7b235 => generated 109 bytes in 538 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:08:18.473900 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-09a77cb8-9eeb-4fef-ac35-4b220c39156d tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Calling method '.version_select at 0x7f741a57f820>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:18.618028 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-09a77cb8-9eeb-4fef-ac35-4b220c39156d tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/882d1f30-1e20-4852-afba-1c0c2b9ce063" status: 200 len: 288 microversion: 2.1 time: 0.150108 Aug 19 21:08:18.621936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 16/25] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Aug 19 21:08:18 2022] GET /compute/v2.1/os-snapshots/882d1f30-1e20-4852-afba-1c0c2b9ce063 => generated 288 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:08:18.665448 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c0fc3cda-8a34-4835-9a70-708a7d60cc25 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Calling method '.version_select at 0x7f7419b36040>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:19.071828 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-c0fc3cda-8a34-4835-9a70-708a7d60cc25 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/882d1f30-1e20-4852-afba-1c0c2b9ce063" status: 202 len: 0 microversion: 2.1 time: 0.433222 Aug 19 21:08:19.072787 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 17/26] 10.222.0.16 () {58 vars in 1254 bytes} [Fri Aug 19 21:08:18 2022] DELETE /compute/v2.1/os-snapshots/882d1f30-1e20-4852-afba-1c0c2b9ce063 => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:08:19.081872 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-90e69598-02e0-4f21-937f-6a40bbb6d1a9 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Calling method '.version_select at 0x7f7419b36700>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:19.145032 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-90e69598-02e0-4f21-937f-6a40bbb6d1a9 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/882d1f30-1e20-4852-afba-1c0c2b9ce063" status: 200 len: 287 microversion: 2.1 time: 0.067468 Aug 19 21:08:19.145944 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 18/27] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Aug 19 21:08:19 2022] GET /compute/v2.1/os-snapshots/882d1f30-1e20-4852-afba-1c0c2b9ce063 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:08:20.172696 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-4e364407-435f-4e2b-9cda-140031a9746b tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Calling method '.version_select at 0x7f7419b36dc0>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:20.268377 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-4e364407-435f-4e2b-9cda-140031a9746b tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] HTTP exception thrown: Snapshot 882d1f30-1e20-4852-afba-1c0c2b9ce063 could not be found. Aug 19 21:08:20.271751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-4e364407-435f-4e2b-9cda-140031a9746b tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Request method failure captured: Aug 19 21:08:20.271751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: GET /compute/v2.1/os-snapshots/882d1f30-1e20-4852-afba-1c0c2b9ce063 HTTP/1.1 Aug 19 21:08:20.271751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:08:20.271751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:08:20.271751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:08:20.271751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:08:20.271751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:08:20.271751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:08:20.271751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:08:20.271751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:08:20.271751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__u1F1bpFvK_UL3Sl0OfHA2TOmher-oXG-38Av2Q8M0aX_MhsroBAPXg8OEEW_dOA5aZL9rjA8LfIHyoyDW-VFSsah4dpwaFnOUY7bqzi8zUEW33bRGVIEGFWtsbVAWznMQ2YW09Ik2DOSReS4FS8ZxucTGoMwXCBoF4vEOYe0hjfoM Aug 19 21:08:20.271751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:08:20.271751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:08:20.271751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:08:20.271751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:08:20.271751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:08:20.271751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:08:20.271751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: c654ccea4cb549a5848505a75432b760 Aug 19 21:08:20.271751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1158264294 Aug 19 21:08:20.271751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:08:20.271751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:08:20.274967 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c654ccea4cb549a5848505a75432b760"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c654ccea4cb549a5848505a75432b760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c654ccea4cb549a5848505a75432b760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c654ccea4cb549a5848505a75432b760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:08:20.274967 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1158264294 Aug 19 21:08:20.274967 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: c654ccea4cb549a5848505a75432b760 Aug 19 21:08:20.274967 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1158264294 Aug 19 21:08:20.274967 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-VolumesSnapshotsTestJSON-1158264294-project Aug 19 21:08:20.274967 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:08:20.274967 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:08:20.274967 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: 65aaea0b67d94ad2a80a5acb7b4a3bec Aug 19 21:08:20.274967 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1158264294-project Aug 19 21:08:20.274967 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: Aug 19 21:08:20.274967 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Snapshot 882d1f30-1e20-4852-afba-1c0c2b9ce063 could not be found. Aug 19 21:08:20.274967 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'id': '882d1f30-1e20-4852-afba-1c0c2b9ce063'} Aug 19 21:08:20.274967 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:08:20.276468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:08:20.276468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 19 21:08:20.276468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 19 21:08:20.276468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 19 21:08:20.276468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 19 21:08:20.276468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 19 21:08:20.276468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 19 21:08:20.276468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 21:08:20.276468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 21:08:20.276468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 21:08:20.276468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 21:08:20.276468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 21:08:20.276468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 21:08:20.276468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 21:08:20.276468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 21:08:20.276468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 882d1f30-1e20-4852-afba-1c0c2b9ce063 could not be found. (HTTP 404) (Request-ID: req-292b3059-1c85-42bc-b1c1-1e852999e454) Aug 19 21:08:20.276468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:08:20.276468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:08:20.279419 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:08:20.279419 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:08:20.279419 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 19 21:08:20.279419 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 19 21:08:20.279419 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 19 21:08:20.279419 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 19 21:08:20.279419 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 19 21:08:20.279419 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 19 21:08:20.279419 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 19 21:08:20.279419 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 19 21:08:20.279419 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 19 21:08:20.279419 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 19 21:08:20.279419 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 19 21:08:20.279419 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 19 21:08:20.279419 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 19 21:08:20.279419 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 19 21:08:20.279419 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 21:08:20.279419 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 21:08:20.279419 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 21:08:20.286429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 21:08:20.286429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 21:08:20.286429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 21:08:20.286429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 21:08:20.286429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 21:08:20.286429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 882d1f30-1e20-4852-afba-1c0c2b9ce063 could not be found. Aug 19 21:08:20.286429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:08:20.286429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:08:20.286429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:08:20.286429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:08:20.286429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:08:20.286429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:08:20.286429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:08:20.286429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:08:20.286429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 21:08:20.286429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 21:08:20.286429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:08:20.286429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:08:20.286429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 19 21:08:20.286429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:08:20.291181 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 882d1f30-1e20-4852-afba-1c0c2b9ce063 could not be found. Aug 19 21:08:20.291181 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:08:20.291181 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:08:20.291181 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:08:20.291181 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:08:20.291181 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:08:20.291181 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:08:20.291181 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:08:20.291181 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:08:20.291181 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 882d1f30-1e20-4852-afba-1c0c2b9ce063 could not be found. Aug 19 21:08:20.291181 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:08:20.291181 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-4e364407-435f-4e2b-9cda-140031a9746b tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Returning 404 to user: Snapshot 882d1f30-1e20-4852-afba-1c0c2b9ce063 could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:08:20.291181 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-4e364407-435f-4e2b-9cda-140031a9746b tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/882d1f30-1e20-4852-afba-1c0c2b9ce063" status: 404 len: 111 microversion: 2.1 time: 0.119406 Aug 19 21:08:20.293737 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 19/28] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Aug 19 21:08:20 2022] GET /compute/v2.1/os-snapshots/882d1f30-1e20-4852-afba-1c0c2b9ce063 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:08:20.293737 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0a5035f6-2193-4a2c-813d-1cca97a96d0f tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Calling method '.version_select at 0x7f7419b36430>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:20.722241 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0a5035f6-2193-4a2c-813d-1cca97a96d0f tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/2a78265d-3ef3-48c8-8006-cda964ee004c" status: 202 len: 0 microversion: 2.1 time: 0.440680 Aug 19 21:08:20.724818 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 20/29] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Aug 19 21:08:20 2022] DELETE /compute/v2.1/os-volumes/2a78265d-3ef3-48c8-8006-cda964ee004c => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:08:20.749048 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-d16f8e64-8bfd-47a5-8240-9e3536cfc5e6 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Calling method '.version_select at 0x7f7419bc8dc0>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:20.852021 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-0bbdf8e1-8ed8-4339-966e-57ae9a345826 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Flavor limits 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 21:08:20.852905 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-0bbdf8e1-8ed8-4339-966e-57ae9a345826 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Image limits 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 21:08:20.853384 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-0bbdf8e1-8ed8-4339-966e-57ae9a345826 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Flavor pref 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 21:08:20.854275 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-0bbdf8e1-8ed8-4339-966e-57ae9a345826 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Image pref 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 21:08:20.855247 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-0bbdf8e1-8ed8-4339-966e-57ae9a345826 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 21:08:20.890420 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-d16f8e64-8bfd-47a5-8240-9e3536cfc5e6 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/2a78265d-3ef3-48c8-8006-cda964ee004c" status: 200 len: 345 microversion: 2.1 time: 0.159861 Aug 19 21:08:20.891187 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 21/30] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Aug 19 21:08:20 2022] GET /compute/v2.1/os-volumes/2a78265d-3ef3-48c8-8006-cda964ee004c => generated 345 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:08:20.893945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0bbdf8e1-8ed8-4339-966e-57ae9a345826 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:20.895175 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0bbdf8e1-8ed8-4339-966e-57ae9a345826 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:20.895791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0bbdf8e1-8ed8-4339-966e-57ae9a345826 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:20.897231 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0bbdf8e1-8ed8-4339-966e-57ae9a345826 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:20.898306 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0bbdf8e1-8ed8-4339-966e-57ae9a345826 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:20.899298 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0bbdf8e1-8ed8-4339-966e-57ae9a345826 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:20.961433 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-0bbdf8e1-8ed8-4339-966e-57ae9a345826 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Getting quotas for project 1c4004ba973b4454865b889d6d1e049a. Resources: {'cores', 'ram', 'instances'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:08:20.974644 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-0bbdf8e1-8ed8-4339-966e-57ae9a345826 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Getting quotas for user e8e345dbc2114b718c98c70844352c63 and project 1c4004ba973b4454865b889d6d1e049a. Resources: {'cores', 'ram', 'instances'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:08:20.991057 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-0bbdf8e1-8ed8-4339-966e-57ae9a345826 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Going to run 1 instances... {{(pid=120876) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 21:08:20.998920 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-0bbdf8e1-8ed8-4339-966e-57ae9a345826 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f034cf-f103-477b-bbb5-3298c678db05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 21:08:21.237794 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-0bbdf8e1-8ed8-4339-966e-57ae9a345826 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.987269 Aug 19 21:08:21.249622 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 10/31] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Aug 19 21:08:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 4993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 21:08:21.255818 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-cdd68992-aa2a-4d39-8b47-7faa01a20e56 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:21.256686 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-cdd68992-aa2a-4d39-8b47-7faa01a20e56 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:21.576834 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-cdd68992-aa2a-4d39-8b47-7faa01a20e56 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:21.615762 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-cdd68992-aa2a-4d39-8b47-7faa01a20e56 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1221 microversion: 2.1 time: 0.364306 Aug 19 21:08:21.620906 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 22/32] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:21 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1221 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:21.906985 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-df3e8616-6c9e-49a6-8536-d372b5a62fa9 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Calling method '.version_select at 0x7f7418aab160>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:21.970082 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-df3e8616-6c9e-49a6-8536-d372b5a62fa9 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] HTTP exception thrown: Volume 2a78265d-3ef3-48c8-8006-cda964ee004c could not be found. Aug 19 21:08:21.974762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-df3e8616-6c9e-49a6-8536-d372b5a62fa9 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Request method failure captured: Aug 19 21:08:21.974762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: GET /compute/v2.1/os-volumes/2a78265d-3ef3-48c8-8006-cda964ee004c HTTP/1.1 Aug 19 21:08:21.974762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:08:21.974762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:08:21.974762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:08:21.974762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:08:21.974762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:08:21.974762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:08:21.974762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:08:21.974762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:08:21.974762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__u1F1bpFvK_UL3Sl0OfHA2TOmher-oXG-38Av2Q8M0aX_MhsroBAPXg8OEEW_dOA5aZL9rjA8LfIHyoyDW-VFSsah4dpwaFnOUY7bqzi8zUEW33bRGVIEGFWtsbVAWznMQ2YW09Ik2DOSReS4FS8ZxucTGoMwXCBoF4vEOYe0hjfoM Aug 19 21:08:21.974762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:08:21.974762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:08:21.974762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:08:21.974762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:08:21.974762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:08:21.974762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:08:21.974762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: c654ccea4cb549a5848505a75432b760 Aug 19 21:08:21.974762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1158264294 Aug 19 21:08:21.974762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:08:21.974762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:08:21.975911 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c654ccea4cb549a5848505a75432b760"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c654ccea4cb549a5848505a75432b760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c654ccea4cb549a5848505a75432b760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c654ccea4cb549a5848505a75432b760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:08:21.975911 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1158264294 Aug 19 21:08:21.975911 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: c654ccea4cb549a5848505a75432b760 Aug 19 21:08:21.975911 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1158264294 Aug 19 21:08:21.975911 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-VolumesSnapshotsTestJSON-1158264294-project Aug 19 21:08:21.975911 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:08:21.975911 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:08:21.975911 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: 65aaea0b67d94ad2a80a5acb7b4a3bec Aug 19 21:08:21.975911 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1158264294-project Aug 19 21:08:21.975911 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: Aug 19 21:08:21.975911 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Volume 2a78265d-3ef3-48c8-8006-cda964ee004c could not be found. Aug 19 21:08:21.975911 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': '2a78265d-3ef3-48c8-8006-cda964ee004c'} Aug 19 21:08:21.975911 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:08:21.976628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:08:21.976628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 21:08:21.976628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 21:08:21.976628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 19 21:08:21.976628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 19 21:08:21.976628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 19 21:08:21.976628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 19 21:08:21.976628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 21:08:21.976628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 21:08:21.976628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 21:08:21.976628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 21:08:21.976628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 21:08:21.976628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 21:08:21.976628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 21:08:21.976628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 21:08:21.976628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a78265d-3ef3-48c8-8006-cda964ee004c could not be found. (HTTP 404) (Request-ID: req-84d50142-6a7b-44ea-b61a-ebbde97530d6) Aug 19 21:08:21.976628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:08:21.976628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:08:21.976628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:08:21.977511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:08:21.977511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 19 21:08:21.977511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 19 21:08:21.977511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 19 21:08:21.977511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 19 21:08:21.977511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 19 21:08:21.977511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 19 21:08:21.977511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 19 21:08:21.977511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 19 21:08:21.977511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 21:08:21.977511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 21:08:21.977511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 19 21:08:21.977511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 19 21:08:21.977511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 19 21:08:21.977511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 19 21:08:21.977511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 21:08:21.977511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 21:08:21.977511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 21:08:21.977511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 21:08:21.978550 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 21:08:21.978550 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 21:08:21.978550 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 21:08:21.978550 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 21:08:21.978550 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a78265d-3ef3-48c8-8006-cda964ee004c could not be found. Aug 19 21:08:21.978550 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:08:21.978550 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:08:21.978550 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:08:21.978550 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:08:21.978550 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:08:21.978550 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:08:21.978550 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:08:21.978550 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:08:21.978550 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 21:08:21.978550 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 21:08:21.978550 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:08:21.978550 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:08:21.978550 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 19 21:08:21.978550 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:08:21.979456 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a78265d-3ef3-48c8-8006-cda964ee004c could not be found. Aug 19 21:08:21.979456 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:08:21.979456 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:08:21.979456 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:08:21.979456 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:08:21.979456 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:08:21.979456 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:08:21.979456 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:08:21.979456 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:08:21.979456 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a78265d-3ef3-48c8-8006-cda964ee004c could not be found. Aug 19 21:08:21.979456 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:08:21.981998 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-df3e8616-6c9e-49a6-8536-d372b5a62fa9 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Returning 404 to user: Volume 2a78265d-3ef3-48c8-8006-cda964ee004c could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:08:21.983465 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-df3e8616-6c9e-49a6-8536-d372b5a62fa9 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/2a78265d-3ef3-48c8-8006-cda964ee004c" status: 404 len: 109 microversion: 2.1 time: 0.081137 Aug 19 21:08:21.987803 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 11/33] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Aug 19 21:08:21 2022] GET /compute/v2.1/os-volumes/2a78265d-3ef3-48c8-8006-cda964ee004c => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:08:21.989972 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-1c77347c-2195-40e8-9229-f88b5466c502 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-694074420", "imageRef": "d1f034cf-f103-477b-bbb5-3298c678db05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:08:22.022980 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-eb01f936-1f2e-44b7-85db-f0c781dc843c tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Calling method '.version_select at 0x7f7418a8b5e0>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:22.109523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-eb01f936-1f2e-44b7-85db-f0c781dc843c tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] HTTP exception thrown: Volume 2a78265d-3ef3-48c8-8006-cda964ee004c could not be found. Aug 19 21:08:22.122096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-eb01f936-1f2e-44b7-85db-f0c781dc843c tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Request method failure captured: Aug 19 21:08:22.122096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: DELETE /compute/v2.1/os-volumes/2a78265d-3ef3-48c8-8006-cda964ee004c HTTP/1.1 Aug 19 21:08:22.122096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:08:22.122096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:08:22.122096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:08:22.122096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:08:22.122096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:08:22.122096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:08:22.122096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:08:22.122096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:08:22.122096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__u1F1bpFvK_UL3Sl0OfHA2TOmher-oXG-38Av2Q8M0aX_MhsroBAPXg8OEEW_dOA5aZL9rjA8LfIHyoyDW-VFSsah4dpwaFnOUY7bqzi8zUEW33bRGVIEGFWtsbVAWznMQ2YW09Ik2DOSReS4FS8ZxucTGoMwXCBoF4vEOYe0hjfoM Aug 19 21:08:22.122096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:08:22.122096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:08:22.122096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:08:22.122096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:08:22.122096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:08:22.122096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:08:22.122096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: c654ccea4cb549a5848505a75432b760 Aug 19 21:08:22.122096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1158264294 Aug 19 21:08:22.122096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:08:22.122096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:08:22.124439 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c654ccea4cb549a5848505a75432b760"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c654ccea4cb549a5848505a75432b760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c654ccea4cb549a5848505a75432b760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c654ccea4cb549a5848505a75432b760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:08:22.124439 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1158264294 Aug 19 21:08:22.124439 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: c654ccea4cb549a5848505a75432b760 Aug 19 21:08:22.124439 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1158264294 Aug 19 21:08:22.124439 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-VolumesSnapshotsTestJSON-1158264294-project Aug 19 21:08:22.124439 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:08:22.124439 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:08:22.124439 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: 65aaea0b67d94ad2a80a5acb7b4a3bec Aug 19 21:08:22.124439 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1158264294-project Aug 19 21:08:22.124439 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: Aug 19 21:08:22.124439 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Volume 2a78265d-3ef3-48c8-8006-cda964ee004c could not be found. Aug 19 21:08:22.124439 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': '2a78265d-3ef3-48c8-8006-cda964ee004c'} Aug 19 21:08:22.124439 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:08:22.125732 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:08:22.125732 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 21:08:22.125732 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 21:08:22.125732 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 19 21:08:22.125732 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 19 21:08:22.125732 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 19 21:08:22.125732 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 19 21:08:22.125732 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 19 21:08:22.125732 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 19 21:08:22.125732 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 19 21:08:22.125732 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 19 21:08:22.125732 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 21:08:22.125732 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 21:08:22.125732 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 21:08:22.125732 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 21:08:22.125732 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a78265d-3ef3-48c8-8006-cda964ee004c could not be found. (HTTP 404) (Request-ID: req-2f52f525-c93a-4951-b6ad-1ff2f57be30d) Aug 19 21:08:22.125732 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:08:22.125732 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:08:22.125732 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:08:22.130839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:08:22.130839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 19 21:08:22.130839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 19 21:08:22.130839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 19 21:08:22.130839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 19 21:08:22.130839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 19 21:08:22.130839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 19 21:08:22.130839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 19 21:08:22.130839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 19 21:08:22.130839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 21:08:22.130839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 21:08:22.130839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 19 21:08:22.130839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 19 21:08:22.130839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 19 21:08:22.130839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 19 21:08:22.130839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 19 21:08:22.130839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 19 21:08:22.130839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 19 21:08:22.130839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 19 21:08:22.139996 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 21:08:22.139996 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 21:08:22.139996 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 21:08:22.139996 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 21:08:22.139996 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a78265d-3ef3-48c8-8006-cda964ee004c could not be found. Aug 19 21:08:22.139996 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:08:22.139996 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:08:22.139996 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:08:22.139996 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:08:22.139996 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:08:22.139996 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:08:22.139996 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:08:22.139996 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:08:22.139996 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 21:08:22.139996 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 21:08:22.139996 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:08:22.139996 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:08:22.139996 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 19 21:08:22.139996 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:08:22.143616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a78265d-3ef3-48c8-8006-cda964ee004c could not be found. Aug 19 21:08:22.143616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:08:22.143616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:08:22.143616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:08:22.143616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:08:22.143616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:08:22.143616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:08:22.143616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:08:22.143616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:08:22.143616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a78265d-3ef3-48c8-8006-cda964ee004c could not be found. Aug 19 21:08:22.143616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:08:22.143616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-eb01f936-1f2e-44b7-85db-f0c781dc843c tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Returning 404 to user: Volume 2a78265d-3ef3-48c8-8006-cda964ee004c could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:08:22.143616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-eb01f936-1f2e-44b7-85db-f0c781dc843c tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/2a78265d-3ef3-48c8-8006-cda964ee004c" status: 404 len: 109 microversion: 2.1 time: 0.111638 Aug 19 21:08:22.143616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 12/34] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Aug 19 21:08:22 2022] DELETE /compute/v2.1/os-volumes/2a78265d-3ef3-48c8-8006-cda964ee004c => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 19 21:08:22.146499 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-f9708602-4e50-4154-ba74-a843dabc0125 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Calling method '.version_select at 0x7f7418a8b8b0>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:22.212603 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-f9708602-4e50-4154-ba74-a843dabc0125 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] HTTP exception thrown: Volume 2a78265d-3ef3-48c8-8006-cda964ee004c could not be found. Aug 19 21:08:22.215136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-f9708602-4e50-4154-ba74-a843dabc0125 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Request method failure captured: Aug 19 21:08:22.215136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: GET /compute/v2.1/os-volumes/2a78265d-3ef3-48c8-8006-cda964ee004c HTTP/1.1 Aug 19 21:08:22.215136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:08:22.215136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:08:22.215136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:08:22.215136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:08:22.215136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:08:22.215136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:08:22.215136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:08:22.215136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:08:22.215136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__u1F1bpFvK_UL3Sl0OfHA2TOmher-oXG-38Av2Q8M0aX_MhsroBAPXg8OEEW_dOA5aZL9rjA8LfIHyoyDW-VFSsah4dpwaFnOUY7bqzi8zUEW33bRGVIEGFWtsbVAWznMQ2YW09Ik2DOSReS4FS8ZxucTGoMwXCBoF4vEOYe0hjfoM Aug 19 21:08:22.215136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:08:22.215136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:08:22.215136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:08:22.215136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:08:22.215136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:08:22.215136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:08:22.215136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: c654ccea4cb549a5848505a75432b760 Aug 19 21:08:22.215136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1158264294 Aug 19 21:08:22.215136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:08:22.215136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:08:22.216538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c654ccea4cb549a5848505a75432b760"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c654ccea4cb549a5848505a75432b760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c654ccea4cb549a5848505a75432b760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c654ccea4cb549a5848505a75432b760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:08:22.216538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1158264294 Aug 19 21:08:22.216538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: c654ccea4cb549a5848505a75432b760 Aug 19 21:08:22.216538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1158264294 Aug 19 21:08:22.216538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-VolumesSnapshotsTestJSON-1158264294-project Aug 19 21:08:22.216538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:08:22.216538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:08:22.216538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: 65aaea0b67d94ad2a80a5acb7b4a3bec Aug 19 21:08:22.216538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1158264294-project Aug 19 21:08:22.216538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: Aug 19 21:08:22.216538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Volume 2a78265d-3ef3-48c8-8006-cda964ee004c could not be found. Aug 19 21:08:22.216538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': '2a78265d-3ef3-48c8-8006-cda964ee004c'} Aug 19 21:08:22.216538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:08:22.217300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:08:22.217300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 21:08:22.217300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 21:08:22.217300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 19 21:08:22.217300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 19 21:08:22.217300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 19 21:08:22.217300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 19 21:08:22.217300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 21:08:22.217300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 21:08:22.217300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 21:08:22.217300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 21:08:22.217300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 21:08:22.217300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 21:08:22.217300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 21:08:22.217300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 21:08:22.217300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a78265d-3ef3-48c8-8006-cda964ee004c could not be found. (HTTP 404) (Request-ID: req-cbae5172-0881-45bb-8258-a45d513849a1) Aug 19 21:08:22.217300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:08:22.217300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:08:22.217300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:08:22.218225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:08:22.218225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 19 21:08:22.218225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 19 21:08:22.218225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 19 21:08:22.218225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 19 21:08:22.218225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 19 21:08:22.218225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 19 21:08:22.218225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 19 21:08:22.218225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 19 21:08:22.218225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 21:08:22.218225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 21:08:22.218225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 19 21:08:22.218225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 19 21:08:22.218225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 19 21:08:22.218225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 19 21:08:22.218225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 21:08:22.218225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 21:08:22.218225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 21:08:22.218225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 21:08:22.219087 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 21:08:22.219087 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 21:08:22.219087 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 21:08:22.219087 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 21:08:22.219087 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a78265d-3ef3-48c8-8006-cda964ee004c could not be found. Aug 19 21:08:22.219087 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:08:22.219087 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:08:22.219087 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:08:22.219087 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:08:22.219087 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:08:22.219087 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:08:22.219087 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:08:22.219087 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:08:22.219087 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 21:08:22.219087 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 21:08:22.219087 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:08:22.219087 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:08:22.219087 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 19 21:08:22.219087 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:08:22.219977 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a78265d-3ef3-48c8-8006-cda964ee004c could not be found. Aug 19 21:08:22.219977 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:08:22.219977 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:08:22.219977 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:08:22.219977 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:08:22.219977 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:08:22.219977 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:08:22.219977 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:08:22.219977 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:08:22.219977 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a78265d-3ef3-48c8-8006-cda964ee004c could not be found. Aug 19 21:08:22.219977 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:08:22.219977 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-f9708602-4e50-4154-ba74-a843dabc0125 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] Returning 404 to user: Volume 2a78265d-3ef3-48c8-8006-cda964ee004c could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:08:22.219977 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-f9708602-4e50-4154-ba74-a843dabc0125 tempest-VolumesSnapshotsTestJSON-1158264294 tempest-VolumesSnapshotsTestJSON-1158264294-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/2a78265d-3ef3-48c8-8006-cda964ee004c" status: 404 len: 109 microversion: 2.1 time: 0.080384 Aug 19 21:08:22.219977 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 13/35] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Aug 19 21:08:22 2022] GET /compute/v2.1/os-volumes/2a78265d-3ef3-48c8-8006-cda964ee004c => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:08:22.325407 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.network.neutron [None req-1c77347c-2195-40e8-9229-f88b5466c502 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] validate_networks() for [('191d091b-fd3f-485e-a729-86fc2a15707b', None, None, None, None, None)] {{(pid=120877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 21:08:26.499807 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-f4e20f4d-3822-4614-8e3c-30b0eba92ca8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1318875182", "imageRef": "d1f034cf-f103-477b-bbb5-3298c678db05", "flavorRef": "452", "networks": [{"uuid": "a7d39564-9ec8-410e-ad00-ca8a3053934a"}]}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:08:26.603863 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.network.neutron [None req-f4e20f4d-3822-4614-8e3c-30b0eba92ca8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] validate_networks() for [('a7d39564-9ec8-410e-ad00-ca8a3053934a', None, None, None, None, None)] {{(pid=120876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 21:08:26.638165 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-1c77347c-2195-40e8-9229-f88b5466c502 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Flavor limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 21:08:26.638955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-1c77347c-2195-40e8-9229-f88b5466c502 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Image limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 21:08:26.639880 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-1c77347c-2195-40e8-9229-f88b5466c502 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Flavor pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 21:08:26.640666 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-1c77347c-2195-40e8-9229-f88b5466c502 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Image pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 21:08:26.647195 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-1c77347c-2195-40e8-9229-f88b5466c502 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 21:08:26.734016 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1c77347c-2195-40e8-9229-f88b5466c502 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:26.746021 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1c77347c-2195-40e8-9229-f88b5466c502 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:26.746974 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1c77347c-2195-40e8-9229-f88b5466c502 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:26.751404 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1c77347c-2195-40e8-9229-f88b5466c502 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:26.752392 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1c77347c-2195-40e8-9229-f88b5466c502 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:26.759740 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1c77347c-2195-40e8-9229-f88b5466c502 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:26.823810 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-1c77347c-2195-40e8-9229-f88b5466c502 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Getting quotas for project 1c4004ba973b4454865b889d6d1e049a. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:08:26.836488 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-1c77347c-2195-40e8-9229-f88b5466c502 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Getting quotas for user e8e345dbc2114b718c98c70844352c63 and project 1c4004ba973b4454865b889d6d1e049a. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:08:26.860802 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-1c77347c-2195-40e8-9229-f88b5466c502 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Going to run 1 instances... {{(pid=120877) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 21:08:26.870128 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-1c77347c-2195-40e8-9229-f88b5466c502 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f034cf-f103-477b-bbb5-3298c678db05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 21:08:27.188158 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-1c77347c-2195-40e8-9229-f88b5466c502 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.203139 Aug 19 21:08:27.190126 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 23/36] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Aug 19 21:08:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 5206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 19 21:08:27.214666 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-7166ba84-5ba4-4842-a10d-490e4c4dd39c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:27.215830 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-7166ba84-5ba4-4842-a10d-490e4c4dd39c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:27.496864 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-7166ba84-5ba4-4842-a10d-490e4c4dd39c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:27.522516 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-7166ba84-5ba4-4842-a10d-490e4c4dd39c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1221 microversion: 2.1 time: 0.320551 Aug 19 21:08:27.539872 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 24/37] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:27 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1221 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:28.546985 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-26074095-4e19-42d6-9462-1734123b4164 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:28.548489 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-26074095-4e19-42d6-9462-1734123b4164 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:28.787404 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-f4e20f4d-3822-4614-8e3c-30b0eba92ca8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Flavor limits 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 21:08:28.788044 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-f4e20f4d-3822-4614-8e3c-30b0eba92ca8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Image limits 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 21:08:28.788476 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-f4e20f4d-3822-4614-8e3c-30b0eba92ca8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Flavor pref 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 21:08:28.789001 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-f4e20f4d-3822-4614-8e3c-30b0eba92ca8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Image pref 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 21:08:28.789585 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-f4e20f4d-3822-4614-8e3c-30b0eba92ca8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 21:08:28.888170 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f4e20f4d-3822-4614-8e3c-30b0eba92ca8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:28.899710 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f4e20f4d-3822-4614-8e3c-30b0eba92ca8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:28.904195 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f4e20f4d-3822-4614-8e3c-30b0eba92ca8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:28.917748 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f4e20f4d-3822-4614-8e3c-30b0eba92ca8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:28.925633 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f4e20f4d-3822-4614-8e3c-30b0eba92ca8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:28.930616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f4e20f4d-3822-4614-8e3c-30b0eba92ca8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:29.129595 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-f4e20f4d-3822-4614-8e3c-30b0eba92ca8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Getting quotas for project c0321d32b9014fc0ae63387d3a5032e8. Resources: {'cores', 'ram', 'instances'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:08:29.166820 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-f4e20f4d-3822-4614-8e3c-30b0eba92ca8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Getting quotas for user 593a0461ca714cff98ae43eb8833197c and project c0321d32b9014fc0ae63387d3a5032e8. Resources: {'cores', 'ram', 'instances'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:08:29.303814 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-f4e20f4d-3822-4614-8e3c-30b0eba92ca8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Going to run 1 instances... {{(pid=120876) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 21:08:29.313712 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-26074095-4e19-42d6-9462-1734123b4164 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:29.326081 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-f4e20f4d-3822-4614-8e3c-30b0eba92ca8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f034cf-f103-477b-bbb5-3298c678db05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 21:08:29.327784 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-26074095-4e19-42d6-9462-1734123b4164 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1221 microversion: 2.1 time: 0.782780 Aug 19 21:08:29.346455 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 25/38] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:28 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1221 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:29.686479 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-f4e20f4d-3822-4614-8e3c-30b0eba92ca8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.580939 Aug 19 21:08:29.699824 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 14/39] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Aug 19 21:08:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 19 21:08:29.713328 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-bddc0bf2-0983-4c8e-9ab1-ceb6ca0eeb10 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:29.716469 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-bddc0bf2-0983-4c8e-9ab1-ceb6ca0eeb10 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:30.064051 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-bddc0bf2-0983-4c8e-9ab1-ceb6ca0eeb10 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:30.111875 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-bddc0bf2-0983-4c8e-9ab1-ceb6ca0eeb10 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1215 microversion: 2.1 time: 0.413430 Aug 19 21:08:30.117984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 26/40] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:29 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1215 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:30.355687 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-83f5e800-5a6e-48e7-9ed6-7ce984fc746e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:30.356347 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-83f5e800-5a6e-48e7-9ed6-7ce984fc746e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:30.848167 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-83f5e800-5a6e-48e7-9ed6-7ce984fc746e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:30.963279 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-83f5e800-5a6e-48e7-9ed6-7ce984fc746e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1221 microversion: 2.1 time: 0.608612 Aug 19 21:08:30.968833 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 15/41] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:30 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1221 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:31.141476 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-9c451553-9197-4ef1-ad23-5bc76ee13ddd tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:31.142424 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-9c451553-9197-4ef1-ad23-5bc76ee13ddd tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:31.423014 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-9c451553-9197-4ef1-ad23-5bc76ee13ddd tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:31.448479 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-9c451553-9197-4ef1-ad23-5bc76ee13ddd tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1215 microversion: 2.1 time: 0.311028 Aug 19 21:08:31.452009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 27/42] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:31 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1215 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:32.003835 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-37a441d3-81e6-4978-819d-f4c5a9c3d44d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:32.026810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-37a441d3-81e6-4978-819d-f4c5a9c3d44d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:32.065217 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-37a441d3-81e6-4978-819d-f4c5a9c3d44d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:32.069627 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-37a441d3-81e6-4978-819d-f4c5a9c3d44d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:32.072087 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-37a441d3-81e6-4978-819d-f4c5a9c3d44d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:32.074592 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-37a441d3-81e6-4978-819d-f4c5a9c3d44d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:32.075826 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-37a441d3-81e6-4978-819d-f4c5a9c3d44d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:32.080326 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-37a441d3-81e6-4978-819d-f4c5a9c3d44d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:32.504162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c85e8ead-41cf-439c-a664-dcaf1e15aaf8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:32.514237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-c85e8ead-41cf-439c-a664-dcaf1e15aaf8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:32.576235 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c85e8ead-41cf-439c-a664-dcaf1e15aaf8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:32.609148 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c85e8ead-41cf-439c-a664-dcaf1e15aaf8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:32.611149 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c85e8ead-41cf-439c-a664-dcaf1e15aaf8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:32.614780 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c85e8ead-41cf-439c-a664-dcaf1e15aaf8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:32.620609 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c85e8ead-41cf-439c-a664-dcaf1e15aaf8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:32.627789 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c85e8ead-41cf-439c-a664-dcaf1e15aaf8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:33.289321 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-37a441d3-81e6-4978-819d-f4c5a9c3d44d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:33.323437 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-37a441d3-81e6-4978-819d-f4c5a9c3d44d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1273 microversion: 2.1 time: 1.327596 Aug 19 21:08:33.324534 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 16/43] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:31 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1273 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:33.492596 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c85e8ead-41cf-439c-a664-dcaf1e15aaf8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:33.521288 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-c85e8ead-41cf-439c-a664-dcaf1e15aaf8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1211 microversion: 2.1 time: 1.034158 Aug 19 21:08:33.525353 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 28/44] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:32 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1211 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:34.354313 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-15c6e2c2-a08c-4463-8f22-f32691ea0ffb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:34.359840 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-15c6e2c2-a08c-4463-8f22-f32691ea0ffb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:34.376466 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-15c6e2c2-a08c-4463-8f22-f32691ea0ffb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:34.381131 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-15c6e2c2-a08c-4463-8f22-f32691ea0ffb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:34.382837 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-15c6e2c2-a08c-4463-8f22-f32691ea0ffb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:34.384458 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-15c6e2c2-a08c-4463-8f22-f32691ea0ffb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:34.390693 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-15c6e2c2-a08c-4463-8f22-f32691ea0ffb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:34.392125 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-15c6e2c2-a08c-4463-8f22-f32691ea0ffb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:34.574997 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-fedd1347-2d05-4359-8863-955930d7248f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:34.582522 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-fedd1347-2d05-4359-8863-955930d7248f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:34.616190 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fedd1347-2d05-4359-8863-955930d7248f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:34.618007 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-15c6e2c2-a08c-4463-8f22-f32691ea0ffb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:34.619043 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fedd1347-2d05-4359-8863-955930d7248f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:34.623601 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fedd1347-2d05-4359-8863-955930d7248f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:34.627381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fedd1347-2d05-4359-8863-955930d7248f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:34.630128 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fedd1347-2d05-4359-8863-955930d7248f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:34.631833 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-15c6e2c2-a08c-4463-8f22-f32691ea0ffb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1279 microversion: 2.1 time: 0.285873 Aug 19 21:08:34.636319 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 17/45] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:34 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1279 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:34.647660 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fedd1347-2d05-4359-8863-955930d7248f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:34.933240 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-fedd1347-2d05-4359-8863-955930d7248f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:34.959329 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-fedd1347-2d05-4359-8863-955930d7248f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1267 microversion: 2.1 time: 0.411826 Aug 19 21:08:34.962355 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 29/46] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:34 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1267 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:35.668913 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-bffe3972-dc71-477f-8308-8b40a55afe0b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:35.670009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-bffe3972-dc71-477f-8308-8b40a55afe0b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:35.688944 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bffe3972-dc71-477f-8308-8b40a55afe0b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:35.689950 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bffe3972-dc71-477f-8308-8b40a55afe0b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:35.690154 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bffe3972-dc71-477f-8308-8b40a55afe0b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:35.690769 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bffe3972-dc71-477f-8308-8b40a55afe0b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:35.691233 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bffe3972-dc71-477f-8308-8b40a55afe0b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:35.691664 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bffe3972-dc71-477f-8308-8b40a55afe0b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:36.069461 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-bffe3972-dc71-477f-8308-8b40a55afe0b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:36.152511 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-bffe3972-dc71-477f-8308-8b40a55afe0b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1279 microversion: 2.1 time: 0.486649 Aug 19 21:08:36.160074 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 30/47] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:35 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1279 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:36.198562 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-00691093-da55-4b3b-8f61-0f82a02defaf tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:36.200350 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-00691093-da55-4b3b-8f61-0f82a02defaf tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:36.246846 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-00691093-da55-4b3b-8f61-0f82a02defaf tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:36.250301 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-00691093-da55-4b3b-8f61-0f82a02defaf tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:36.252585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-00691093-da55-4b3b-8f61-0f82a02defaf tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:36.275754 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-00691093-da55-4b3b-8f61-0f82a02defaf tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:36.277243 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-00691093-da55-4b3b-8f61-0f82a02defaf tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:36.280664 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-00691093-da55-4b3b-8f61-0f82a02defaf tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:36.573164 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-00691093-da55-4b3b-8f61-0f82a02defaf tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:36.614215 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-00691093-da55-4b3b-8f61-0f82a02defaf tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1267 microversion: 2.1 time: 0.450448 Aug 19 21:08:36.624013 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 31/48] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:36 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1267 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:36.801172 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-bee10ffb-dfa3-45d6-a937-1efb25252c30 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Action: 'create', calling method: .version_select at 0x7f741896b790>, body: {"keypair": {"name": "tempest-keypair-1232465057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOIeRyPu6Mpz/QnRNnWbJnq9CaGmHrO0ubmdQGw3tNvt6e3trg+AVCOKX4z17YMa3Kc+RN4abxgLPjwliM85C5o2u9Xt/EWhfNBubXPryFmAgg0z/ZEc1duDhBsx/3Unw=="}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:08:36.952559 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-bee10ffb-dfa3-45d6-a937-1efb25252c30 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Getting quotas for project 358e50f9b9df43b7aa0a4ba1353e4a25. Resources: {'key_pairs'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:08:36.987593 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-bee10ffb-dfa3-45d6-a937-1efb25252c30 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Getting quotas for user 7f46019e78cc4e89bf877a4f5a7a8fe9 and project 358e50f9b9df43b7aa0a4ba1353e4a25. Resources: {'key_pairs'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:08:37.185250 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-22c3c247-ef3e-4938-a4de-051d0a0f37d0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:37.196177 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-22c3c247-ef3e-4938-a4de-051d0a0f37d0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:37.228954 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=2 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:37.256097 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-22c3c247-ef3e-4938-a4de-051d0a0f37d0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:37.257464 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-bee10ffb-dfa3-45d6-a937-1efb25252c30 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.920824 Aug 19 21:08:37.264036 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 18/49] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Aug 19 21:08:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1936 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:08:37.271228 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-22c3c247-ef3e-4938-a4de-051d0a0f37d0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:37.272936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-22c3c247-ef3e-4938-a4de-051d0a0f37d0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:37.277788 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-22c3c247-ef3e-4938-a4de-051d0a0f37d0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:37.283503 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-22c3c247-ef3e-4938-a4de-051d0a0f37d0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:37.292372 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-22c3c247-ef3e-4938-a4de-051d0a0f37d0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:37.666551 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-2672602d-c063-4784-9f9a-a1b00a8f9cc9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:37.667657 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-2672602d-c063-4784-9f9a-a1b00a8f9cc9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:37.692146 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2672602d-c063-4784-9f9a-a1b00a8f9cc9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:37.699596 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2672602d-c063-4784-9f9a-a1b00a8f9cc9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:37.701381 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2672602d-c063-4784-9f9a-a1b00a8f9cc9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:37.705799 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2672602d-c063-4784-9f9a-a1b00a8f9cc9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:37.713580 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2672602d-c063-4784-9f9a-a1b00a8f9cc9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:37.718210 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2672602d-c063-4784-9f9a-a1b00a8f9cc9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:37.920072 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-22c3c247-ef3e-4938-a4de-051d0a0f37d0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:37.945127 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-22c3c247-ef3e-4938-a4de-051d0a0f37d0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1279 microversion: 2.1 time: 0.764570 Aug 19 21:08:37.948463 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 32/50] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:37 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1279 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:08:38.359467 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-2672602d-c063-4784-9f9a-a1b00a8f9cc9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:38.369253 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-2672602d-c063-4784-9f9a-a1b00a8f9cc9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1285 microversion: 2.1 time: 0.708172 Aug 19 21:08:38.375492 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 19/51] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:37 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1285 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:08:38.972747 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-057d259c-5088-4d3e-8a0f-73123a143f17 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:38.975474 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-057d259c-5088-4d3e-8a0f-73123a143f17 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:38.990517 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-057d259c-5088-4d3e-8a0f-73123a143f17 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:38.993349 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-057d259c-5088-4d3e-8a0f-73123a143f17 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:38.994854 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-057d259c-5088-4d3e-8a0f-73123a143f17 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:38.996835 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-057d259c-5088-4d3e-8a0f-73123a143f17 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:38.998276 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-057d259c-5088-4d3e-8a0f-73123a143f17 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:38.999466 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-057d259c-5088-4d3e-8a0f-73123a143f17 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:39.406843 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-23dc2515-5597-4837-a224-2214d08187e4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:39.411970 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-23dc2515-5597-4837-a224-2214d08187e4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:39.430064 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=4 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:39.461145 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-23dc2515-5597-4837-a224-2214d08187e4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:39.465565 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-23dc2515-5597-4837-a224-2214d08187e4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:39.467257 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-23dc2515-5597-4837-a224-2214d08187e4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:39.472403 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-23dc2515-5597-4837-a224-2214d08187e4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:39.478574 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-23dc2515-5597-4837-a224-2214d08187e4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:39.480317 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-23dc2515-5597-4837-a224-2214d08187e4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:40.212715 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-23dc2515-5597-4837-a224-2214d08187e4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:40.263199 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-23dc2515-5597-4837-a224-2214d08187e4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1273 microversion: 2.1 time: 0.863530 Aug 19 21:08:40.267270 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 20/52] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:39 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1273 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:40.346847 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-057d259c-5088-4d3e-8a0f-73123a143f17 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:40.435234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-057d259c-5088-4d3e-8a0f-73123a143f17 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1279 microversion: 2.1 time: 1.461594 Aug 19 21:08:40.438780 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 33/53] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:38 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1279 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:40.931680 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-5a7fa287-1b94-4e6e-8528-8e27c772660b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Action: 'create', calling method: .version_select at 0x7f741899bca0>, body: {"keypair": {"name": "tempest-keypair-999809797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgewL6+P0h+JAN9/e2w45poYRRqGi+/ud0dCrp5KoZlFVDoeEdrUBSfxAlklot0qpjjd4T9YQpnF6fbxbnNzJUOkw8eu1SHdjGU6nw9UbHmoOOsMXeW6qjJSEruyp8S5g=="}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:08:41.008079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-5a7fa287-1b94-4e6e-8528-8e27c772660b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Getting quotas for project a3902dce55324b7ab42df9de97bc11b4. Resources: {'key_pairs'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:08:41.046488 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-5a7fa287-1b94-4e6e-8528-8e27c772660b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Getting quotas for user 0809d96091c2476c83ec0c7c6c5a1509 and project a3902dce55324b7ab42df9de97bc11b4. Resources: {'key_pairs'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:08:41.189015 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-5a7fa287-1b94-4e6e-8528-8e27c772660b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.819729 Aug 19 21:08:41.206412 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 21/54] 10.222.0.16 () {62 vars in 1200 bytes} [Fri Aug 19 21:08:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 837 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 19 21:08:41.295560 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-cff36fde-8f25-4db2-a5e6-207f72a6dd53 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:41.296828 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-cff36fde-8f25-4db2-a5e6-207f72a6dd53 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:41.343532 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cff36fde-8f25-4db2-a5e6-207f72a6dd53 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:41.344459 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cff36fde-8f25-4db2-a5e6-207f72a6dd53 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:41.345232 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cff36fde-8f25-4db2-a5e6-207f72a6dd53 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:41.346675 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cff36fde-8f25-4db2-a5e6-207f72a6dd53 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:41.347432 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cff36fde-8f25-4db2-a5e6-207f72a6dd53 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:41.348373 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cff36fde-8f25-4db2-a5e6-207f72a6dd53 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:41.476982 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=16 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:41.483619 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-6ea5ed91-9b8c-4bbf-ac9e-96a3c30c0db0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:41.484438 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-6ea5ed91-9b8c-4bbf-ac9e-96a3c30c0db0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:41.503809 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6ea5ed91-9b8c-4bbf-ac9e-96a3c30c0db0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:41.511564 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6ea5ed91-9b8c-4bbf-ac9e-96a3c30c0db0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:41.512375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6ea5ed91-9b8c-4bbf-ac9e-96a3c30c0db0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:41.515524 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6ea5ed91-9b8c-4bbf-ac9e-96a3c30c0db0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:41.518202 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6ea5ed91-9b8c-4bbf-ac9e-96a3c30c0db0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:41.518876 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6ea5ed91-9b8c-4bbf-ac9e-96a3c30c0db0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:41.819437 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-cff36fde-8f25-4db2-a5e6-207f72a6dd53 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:41.838340 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-cff36fde-8f25-4db2-a5e6-207f72a6dd53 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1273 microversion: 2.1 time: 0.551920 Aug 19 21:08:41.839901 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 34/55] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:41 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1273 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:42.032339 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-6ea5ed91-9b8c-4bbf-ac9e-96a3c30c0db0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:42.074509 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-6ea5ed91-9b8c-4bbf-ac9e-96a3c30c0db0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1279 microversion: 2.1 time: 0.585532 Aug 19 21:08:42.112132 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 22/56] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:41 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1279 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:08:42.884376 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-33cf5dee-d1f4-498d-870b-53f28a0f763f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:42.890119 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-33cf5dee-d1f4-498d-870b-53f28a0f763f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:42.950388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-33cf5dee-d1f4-498d-870b-53f28a0f763f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:42.951159 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-33cf5dee-d1f4-498d-870b-53f28a0f763f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:42.951937 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-33cf5dee-d1f4-498d-870b-53f28a0f763f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:42.953259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-33cf5dee-d1f4-498d-870b-53f28a0f763f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:42.954096 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-33cf5dee-d1f4-498d-870b-53f28a0f763f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:42.954813 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-33cf5dee-d1f4-498d-870b-53f28a0f763f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:43.158354 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-94cb1385-de97-454f-bb2d-489b42c92e8c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:43.171801 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-94cb1385-de97-454f-bb2d-489b42c92e8c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:43.227584 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-94cb1385-de97-454f-bb2d-489b42c92e8c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:43.230392 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-94cb1385-de97-454f-bb2d-489b42c92e8c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:43.232540 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-94cb1385-de97-454f-bb2d-489b42c92e8c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:43.238606 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-94cb1385-de97-454f-bb2d-489b42c92e8c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:43.240308 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-94cb1385-de97-454f-bb2d-489b42c92e8c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:43.242549 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-94cb1385-de97-454f-bb2d-489b42c92e8c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:45.608934 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-94cb1385-de97-454f-bb2d-489b42c92e8c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:45.622426 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-33cf5dee-d1f4-498d-870b-53f28a0f763f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:45.632908 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-33cf5dee-d1f4-498d-870b-53f28a0f763f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1315 microversion: 2.1 time: 2.758754 Aug 19 21:08:45.638477 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 35/57] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:42 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1315 bytes in 2765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:45.690725 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-94cb1385-de97-454f-bb2d-489b42c92e8c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1321 microversion: 2.1 time: 2.544705 Aug 19 21:08:45.709119 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 23/58] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:43 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1321 bytes in 2585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:46.704826 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-fff83b32-39fb-4d62-af07-55ba13e6fc29 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:46.721716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-fff83b32-39fb-4d62-af07-55ba13e6fc29 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:46.729109 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=8 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:46.820651 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fff83b32-39fb-4d62-af07-55ba13e6fc29 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:46.828917 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fff83b32-39fb-4d62-af07-55ba13e6fc29 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:46.830224 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fff83b32-39fb-4d62-af07-55ba13e6fc29 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:46.841163 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fff83b32-39fb-4d62-af07-55ba13e6fc29 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:46.842076 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fff83b32-39fb-4d62-af07-55ba13e6fc29 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:46.864973 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fff83b32-39fb-4d62-af07-55ba13e6fc29 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:46.876283 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3ccf8114-6939-4208-8a8d-1e8ed85bc0fc tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Action: 'create', calling method: .version_select at 0x7f74189385e0>, body: {"keypair": {"name": "tempest-keypair-1681620401", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETxDgMSI3zQn1RzGOn+JC5T/YCRfF3Nhy+PMTTl+6nTFBNV959gHEmw0lpr9Po36yvn5LFhZWlaN5vcYRi0GVMHk3abChFowSH0TE7S/wv5kpVnfnbag2dcuaIz9ps7Cw=="}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:08:46.903593 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:46.983075 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-3ccf8114-6939-4208-8a8d-1e8ed85bc0fc tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Getting quotas for project def1895e8f3b40f1b608240c60a0066a. Resources: {'key_pairs'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:08:46.994675 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-3ccf8114-6939-4208-8a8d-1e8ed85bc0fc tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Getting quotas for user 8810b3e211d448cea9a506d9183dc13d and project def1895e8f3b40f1b608240c60a0066a. Resources: {'key_pairs'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:08:47.010502 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=41 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:47.161987 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-3ccf8114-6939-4208-8a8d-1e8ed85bc0fc tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.920831 Aug 19 21:08:47.169654 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 36/59] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Aug 19 21:08:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:08:47.217904 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-f999d965-90fe-4b5f-927d-3893a720fd93 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:47.223789 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-f999d965-90fe-4b5f-927d-3893a720fd93 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:47.308276 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f999d965-90fe-4b5f-927d-3893a720fd93 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:47.320083 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f999d965-90fe-4b5f-927d-3893a720fd93 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:47.327529 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f999d965-90fe-4b5f-927d-3893a720fd93 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:47.333094 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f999d965-90fe-4b5f-927d-3893a720fd93 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:47.333980 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f999d965-90fe-4b5f-927d-3893a720fd93 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:47.335280 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f999d965-90fe-4b5f-927d-3893a720fd93 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:49.347785 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-fff83b32-39fb-4d62-af07-55ba13e6fc29 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:49.427728 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-fff83b32-39fb-4d62-af07-55ba13e6fc29 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1315 microversion: 2.1 time: 2.766416 Aug 19 21:08:49.440930 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 24/60] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:46 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1315 bytes in 2783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:08:49.934984 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-9600be17-8c04-41ab-83e6-927fd440f1f8 req-a4e8c4b5-aa6e-4e03-9eb6-9ccfd1105978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e363b06b-e5dd-48c8-a0d8-afdfa5bad759", "tag": "851487e1-a850-4116-9209-d8a95dd86a4e"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:08:49.968998 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-9600be17-8c04-41ab-83e6-927fd440f1f8 req-a4e8c4b5-aa6e-4e03-9eb6-9ccfd1105978 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:49.969579 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-9600be17-8c04-41ab-83e6-927fd440f1f8 req-a4e8c4b5-aa6e-4e03-9eb6-9ccfd1105978 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:49.970059 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-9600be17-8c04-41ab-83e6-927fd440f1f8 req-a4e8c4b5-aa6e-4e03-9eb6-9ccfd1105978 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:50.048758 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-9600be17-8c04-41ab-83e6-927fd440f1f8 req-a4e8c4b5-aa6e-4e03-9eb6-9ccfd1105978 service nova] Creating event network-changed:851487e1-a850-4116-9209-d8a95dd86a4e for instance e363b06b-e5dd-48c8-a0d8-afdfa5bad759 on hv-cinder-85220 Aug 19 21:08:50.049364 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-9600be17-8c04-41ab-83e6-927fd440f1f8 req-a4e8c4b5-aa6e-4e03-9eb6-9ccfd1105978 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120876) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 19 21:08:50.049798 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-9600be17-8c04-41ab-83e6-927fd440f1f8 req-a4e8c4b5-aa6e-4e03-9eb6-9ccfd1105978 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120876) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 19 21:08:50.051108 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e4955f8f-063e-47ce-91b4-9c3ffa16f1b7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:50.051605 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e4955f8f-063e-47ce-91b4-9c3ffa16f1b7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:50.052042 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e4955f8f-063e-47ce-91b4-9c3ffa16f1b7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:50.052951 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e4955f8f-063e-47ce-91b4-9c3ffa16f1b7 None None] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:50.076335 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e4955f8f-063e-47ce-91b4-9c3ffa16f1b7 None None] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:50.083429 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e4955f8f-063e-47ce-91b4-9c3ffa16f1b7 None None] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:50.166543 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.compute.rpcapi [None req-e4955f8f-063e-47ce-91b4-9c3ffa16f1b7 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 19 21:08:50.171650 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e4955f8f-063e-47ce-91b4-9c3ffa16f1b7 None None] Releasing lock "compute-rpcapi-router" {{(pid=120876) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 19 21:08:50.244063 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-e4955f8f-063e-47ce-91b4-9c3ffa16f1b7 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.785298 Aug 19 21:08:50.249924 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 25/61] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:08:50.468668 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-2945eeb5-2253-4011-ba66-c48fbce6c4e5 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:50.482518 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-2945eeb5-2253-4011-ba66-c48fbce6c4e5 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:50.511778 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2945eeb5-2253-4011-ba66-c48fbce6c4e5 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:50.512623 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2945eeb5-2253-4011-ba66-c48fbce6c4e5 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:50.536965 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2945eeb5-2253-4011-ba66-c48fbce6c4e5 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:50.551807 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2945eeb5-2253-4011-ba66-c48fbce6c4e5 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:50.560859 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2945eeb5-2253-4011-ba66-c48fbce6c4e5 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:50.565313 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2945eeb5-2253-4011-ba66-c48fbce6c4e5 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:51.123081 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=22 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:51.510459 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-f999d965-90fe-4b5f-927d-3893a720fd93 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:51.521463 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-f999d965-90fe-4b5f-927d-3893a720fd93 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1321 microversion: 2.1 time: 4.345457 Aug 19 21:08:51.532112 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 37/62] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:47 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1321 bytes in 4362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:51.565536 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-2945eeb5-2253-4011-ba66-c48fbce6c4e5 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:51.579262 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-2945eeb5-2253-4011-ba66-c48fbce6c4e5 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1315 microversion: 2.1 time: 1.118427 Aug 19 21:08:51.580459 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 26/63] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:50 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1315 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:52.356605 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-2c4ce3d0-7ade-4246-a1c6-f2e739b90e0f req-6904d433-8749-4544-8d83-886e1d5c9963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4198f280-df5c-423d-9641-15abbd378905", "tag": "f53aeb6e-aa9c-48b2-9f9c-ea05217129dc"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:08:52.400522 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-2c4ce3d0-7ade-4246-a1c6-f2e739b90e0f req-6904d433-8749-4544-8d83-886e1d5c9963 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:52.402060 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-2c4ce3d0-7ade-4246-a1c6-f2e739b90e0f req-6904d433-8749-4544-8d83-886e1d5c9963 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:52.408884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-2c4ce3d0-7ade-4246-a1c6-f2e739b90e0f req-6904d433-8749-4544-8d83-886e1d5c9963 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:52.563185 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-6eb574ce-db08-4620-9267-ca3c6e1d861f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:52.564064 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-6eb574ce-db08-4620-9267-ca3c6e1d861f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:52.565098 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-2c4ce3d0-7ade-4246-a1c6-f2e739b90e0f req-6904d433-8749-4544-8d83-886e1d5c9963 service nova] Creating event network-changed:f53aeb6e-aa9c-48b2-9f9c-ea05217129dc for instance 4198f280-df5c-423d-9641-15abbd378905 on hv-cinder-85220 Aug 19 21:08:52.567128 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-2c4ce3d0-7ade-4246-a1c6-f2e739b90e0f req-6904d433-8749-4544-8d83-886e1d5c9963 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120877) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 19 21:08:52.568083 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-2c4ce3d0-7ade-4246-a1c6-f2e739b90e0f req-6904d433-8749-4544-8d83-886e1d5c9963 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120877) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 19 21:08:52.574212 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58785107-a596-4fa9-8786-e5a567ef7ebb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:52.576814 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58785107-a596-4fa9-8786-e5a567ef7ebb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:52.578361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58785107-a596-4fa9-8786-e5a567ef7ebb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:52.579758 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6eb574ce-db08-4620-9267-ca3c6e1d861f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:52.580474 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6eb574ce-db08-4620-9267-ca3c6e1d861f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:52.580676 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6eb574ce-db08-4620-9267-ca3c6e1d861f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:52.582224 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58785107-a596-4fa9-8786-e5a567ef7ebb None None] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:52.588259 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6eb574ce-db08-4620-9267-ca3c6e1d861f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:52.588745 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6eb574ce-db08-4620-9267-ca3c6e1d861f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:52.589552 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6eb574ce-db08-4620-9267-ca3c6e1d861f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:52.590326 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58785107-a596-4fa9-8786-e5a567ef7ebb None None] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:52.591125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58785107-a596-4fa9-8786-e5a567ef7ebb None None] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:52.606958 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.compute.rpcapi [None req-58785107-a596-4fa9-8786-e5a567ef7ebb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 19 21:08:52.608727 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58785107-a596-4fa9-8786-e5a567ef7ebb None None] Releasing lock "compute-rpcapi-router" {{(pid=120877) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 19 21:08:52.650173 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-58785107-a596-4fa9-8786-e5a567ef7ebb None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.303410 Aug 19 21:08:52.661476 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 38/64] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:08:52.672938 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-d40ae90b-5765-4f98-8d92-1b64f751e0a9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:52.673714 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-d40ae90b-5765-4f98-8d92-1b64f751e0a9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:52.683044 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d40ae90b-5765-4f98-8d92-1b64f751e0a9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:52.686997 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d40ae90b-5765-4f98-8d92-1b64f751e0a9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:52.690114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d40ae90b-5765-4f98-8d92-1b64f751e0a9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:52.714873 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d40ae90b-5765-4f98-8d92-1b64f751e0a9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:52.715749 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d40ae90b-5765-4f98-8d92-1b64f751e0a9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:52.718173 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d40ae90b-5765-4f98-8d92-1b64f751e0a9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:54.855465 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-6eb574ce-db08-4620-9267-ca3c6e1d861f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:54.857792 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-d40ae90b-5765-4f98-8d92-1b64f751e0a9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:54.869918 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-6eb574ce-db08-4620-9267-ca3c6e1d861f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1321 microversion: 2.1 time: 2.310376 Aug 19 21:08:54.872048 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 27/65] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:52 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1321 bytes in 2314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:08:54.872589 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-d40ae90b-5765-4f98-8d92-1b64f751e0a9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1315 microversion: 2.1 time: 2.209541 Aug 19 21:08:54.873172 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 39/66] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:52 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1315 bytes in 2211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:54.886390 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-2c392590-6ff6-4522-991e-b4b695708aca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2110378890", "imageRef": "d1f034cf-f103-477b-bbb5-3298c678db05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b0fd483-0b8c-45b1-8b1c-2c76848b5463"}], "security_groups": [{"name": "tempest-securitygroup--1578153960"}], "key_name": "tempest-keypair-1232465057", "user_data": "}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:08:55.251013 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-135a3a0b-61fd-4fca-b540-5c9e3a38ff4a req-ae718965-cfda-4ebf-8bbe-700501d772c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeac61e2-44ff-4477-94da-a109f4907096", "tag": "554843a8-960c-4d22-858b-254efc47fd8c"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:08:55.262978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-135a3a0b-61fd-4fca-b540-5c9e3a38ff4a req-ae718965-cfda-4ebf-8bbe-700501d772c3 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:55.263719 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-135a3a0b-61fd-4fca-b540-5c9e3a38ff4a req-ae718965-cfda-4ebf-8bbe-700501d772c3 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:55.264149 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-135a3a0b-61fd-4fca-b540-5c9e3a38ff4a req-ae718965-cfda-4ebf-8bbe-700501d772c3 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:55.276129 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.network.neutron [None req-2c392590-6ff6-4522-991e-b4b695708aca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] validate_networks() for [('8b0fd483-0b8c-45b1-8b1c-2c76848b5463', None, None, None, None, None)] {{(pid=120877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 21:08:55.278896 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-135a3a0b-61fd-4fca-b540-5c9e3a38ff4a req-ae718965-cfda-4ebf-8bbe-700501d772c3 service nova] Creating event network-changed:554843a8-960c-4d22-858b-254efc47fd8c for instance eeac61e2-44ff-4477-94da-a109f4907096 on hv-cinder-85220 Aug 19 21:08:55.285259 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-135a3a0b-61fd-4fca-b540-5c9e3a38ff4a req-ae718965-cfda-4ebf-8bbe-700501d772c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.410911 Aug 19 21:08:55.286496 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 28/67] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:08:55.903601 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-93c69efe-fa6c-410b-8206-25500f257c35 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:55.906541 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-93c69efe-fa6c-410b-8206-25500f257c35 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:55.920170 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-93c69efe-fa6c-410b-8206-25500f257c35 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:55.921163 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-93c69efe-fa6c-410b-8206-25500f257c35 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:55.921802 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-93c69efe-fa6c-410b-8206-25500f257c35 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:55.923464 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-93c69efe-fa6c-410b-8206-25500f257c35 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:55.924576 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-93c69efe-fa6c-410b-8206-25500f257c35 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:55.926172 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-93c69efe-fa6c-410b-8206-25500f257c35 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:56.491331 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-93c69efe-fa6c-410b-8206-25500f257c35 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:56.500429 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-93c69efe-fa6c-410b-8206-25500f257c35 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1321 microversion: 2.1 time: 0.610320 Aug 19 21:08:56.501046 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 29/68] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:55 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1321 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:08:56.506952 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-44bf567b-8492-4059-a954-8f637b142784 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:56.507799 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-44bf567b-8492-4059-a954-8f637b142784 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:56.517097 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-44bf567b-8492-4059-a954-8f637b142784 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:56.518985 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-44bf567b-8492-4059-a954-8f637b142784 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:56.520625 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-44bf567b-8492-4059-a954-8f637b142784 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:56.522378 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-44bf567b-8492-4059-a954-8f637b142784 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:56.524135 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-44bf567b-8492-4059-a954-8f637b142784 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:56.525486 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-44bf567b-8492-4059-a954-8f637b142784 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:56.892785 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-2c392590-6ff6-4522-991e-b4b695708aca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Flavor limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 21:08:56.894167 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-2c392590-6ff6-4522-991e-b4b695708aca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Image limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 21:08:56.894785 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-2c392590-6ff6-4522-991e-b4b695708aca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Flavor pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 21:08:56.895335 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-2c392590-6ff6-4522-991e-b4b695708aca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Image pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 21:08:56.895980 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-2c392590-6ff6-4522-991e-b4b695708aca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 21:08:56.910841 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2c392590-6ff6-4522-991e-b4b695708aca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:56.912863 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2c392590-6ff6-4522-991e-b4b695708aca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:56.914538 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2c392590-6ff6-4522-991e-b4b695708aca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:56.915228 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2c392590-6ff6-4522-991e-b4b695708aca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:56.915836 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2c392590-6ff6-4522-991e-b4b695708aca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:56.916498 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2c392590-6ff6-4522-991e-b4b695708aca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:56.925054 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=67 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:08:56.946929 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-2c392590-6ff6-4522-991e-b4b695708aca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Getting quotas for project 358e50f9b9df43b7aa0a4ba1353e4a25. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:08:56.952886 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-2c392590-6ff6-4522-991e-b4b695708aca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Getting quotas for user 7f46019e78cc4e89bf877a4f5a7a8fe9 and project 358e50f9b9df43b7aa0a4ba1353e4a25. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:08:56.970978 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-2c392590-6ff6-4522-991e-b4b695708aca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Going to run 1 instances... {{(pid=120877) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 21:08:56.973844 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-2c392590-6ff6-4522-991e-b4b695708aca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f034cf-f103-477b-bbb5-3298c678db05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 21:08:57.054194 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-2c392590-6ff6-4522-991e-b4b695708aca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.178236 Aug 19 21:08:57.065816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 40/69] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Aug 19 21:08:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 2182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 21:08:57.085073 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-edfb91c1-1646-4128-bfd0-65e3fa240f0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1304961425", "imageRef": "d1f034cf-f103-477b-bbb5-3298c678db05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2dcec4c-6e1c-499b-93c8-b09724f309db"}], "security_groups": [{"name": "tempest-securitygroup--896808354"}], "key_name": "tempest-keypair-999809797", "user_data": "}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:08:57.109721 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-44bf567b-8492-4059-a954-8f637b142784 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:57.135513 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-44bf567b-8492-4059-a954-8f637b142784 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1315 microversion: 2.1 time: 0.633330 Aug 19 21:08:57.138324 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 30/70] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:56 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1315 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:57.171114 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-8fb08cf2-cf51-424a-8f68-4867ec6d175f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:57.184036 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-8fb08cf2-cf51-424a-8f68-4867ec6d175f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:57.278959 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-8fb08cf2-cf51-424a-8f68-4867ec6d175f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:57.307256 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-8fb08cf2-cf51-424a-8f68-4867ec6d175f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1242 microversion: 2.1 time: 0.154290 Aug 19 21:08:57.313320 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 31/71] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:57 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1242 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:57.355849 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.network.neutron [None req-edfb91c1-1646-4128-bfd0-65e3fa240f0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] validate_networks() for [('a2dcec4c-6e1c-499b-93c8-b09724f309db', None, None, None, None, None)] {{(pid=120877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 21:08:57.540987 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-b916538c-d38c-4f93-8f39-36ec2c8af34e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:57.541608 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-b916538c-d38c-4f93-8f39-36ec2c8af34e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:57.549638 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b916538c-d38c-4f93-8f39-36ec2c8af34e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:57.550820 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b916538c-d38c-4f93-8f39-36ec2c8af34e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:57.551595 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b916538c-d38c-4f93-8f39-36ec2c8af34e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:57.553940 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b916538c-d38c-4f93-8f39-36ec2c8af34e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:57.561701 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b916538c-d38c-4f93-8f39-36ec2c8af34e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:57.562836 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b916538c-d38c-4f93-8f39-36ec2c8af34e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:58.199255 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b916538c-d38c-4f93-8f39-36ec2c8af34e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:58.208374 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-b916538c-d38c-4f93-8f39-36ec2c8af34e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1321 microversion: 2.1 time: 0.672398 Aug 19 21:08:58.222780 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 32/72] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:57 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1321 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:58.233073 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-41fc4e52-e5de-4a5f-be5a-b537d3545edd tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:58.234568 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-41fc4e52-e5de-4a5f-be5a-b537d3545edd tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:58.243347 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-41fc4e52-e5de-4a5f-be5a-b537d3545edd tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:58.244030 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-41fc4e52-e5de-4a5f-be5a-b537d3545edd tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:58.244622 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-41fc4e52-e5de-4a5f-be5a-b537d3545edd tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:58.245799 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-41fc4e52-e5de-4a5f-be5a-b537d3545edd tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:58.246421 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-41fc4e52-e5de-4a5f-be5a-b537d3545edd tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:58.246981 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-41fc4e52-e5de-4a5f-be5a-b537d3545edd tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:58.520505 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-41fc4e52-e5de-4a5f-be5a-b537d3545edd tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:58.522428 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-edfb91c1-1646-4128-bfd0-65e3fa240f0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Flavor limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 21:08:58.523406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-edfb91c1-1646-4128-bfd0-65e3fa240f0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Image limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 21:08:58.523975 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-edfb91c1-1646-4128-bfd0-65e3fa240f0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Flavor pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 21:08:58.524629 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-edfb91c1-1646-4128-bfd0-65e3fa240f0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Image pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 21:08:58.525120 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-edfb91c1-1646-4128-bfd0-65e3fa240f0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 21:08:58.532418 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-41fc4e52-e5de-4a5f-be5a-b537d3545edd tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1315 microversion: 2.1 time: 0.307892 Aug 19 21:08:58.533668 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 33/73] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:58 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:58.536858 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-edfb91c1-1646-4128-bfd0-65e3fa240f0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:58.537403 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-edfb91c1-1646-4128-bfd0-65e3fa240f0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:58.538055 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-edfb91c1-1646-4128-bfd0-65e3fa240f0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:58.538846 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-edfb91c1-1646-4128-bfd0-65e3fa240f0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:58.539312 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-edfb91c1-1646-4128-bfd0-65e3fa240f0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:58.539739 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-edfb91c1-1646-4128-bfd0-65e3fa240f0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:58.557470 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-15ae7ad5-4c0f-483f-a028-e9e4d685bbfb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1950038921", "imageRef": "d1f034cf-f103-477b-bbb5-3298c678db05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb2d1e82-7c52-4d84-986e-754913029373"}], "security_groups": [{"name": "tempest-securitygroup--752081944"}], "key_name": "tempest-keypair-1681620401", "user_data": "}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:08:58.565591 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-edfb91c1-1646-4128-bfd0-65e3fa240f0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Getting quotas for project a3902dce55324b7ab42df9de97bc11b4. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:08:58.574767 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-edfb91c1-1646-4128-bfd0-65e3fa240f0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Getting quotas for user 0809d96091c2476c83ec0c7c6c5a1509 and project a3902dce55324b7ab42df9de97bc11b4. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:08:58.604911 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-edfb91c1-1646-4128-bfd0-65e3fa240f0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Going to run 1 instances... {{(pid=120877) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 21:08:58.609554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-edfb91c1-1646-4128-bfd0-65e3fa240f0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f034cf-f103-477b-bbb5-3298c678db05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 21:08:58.697411 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.network.neutron [None req-15ae7ad5-4c0f-483f-a028-e9e4d685bbfb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] validate_networks() for [('cb2d1e82-7c52-4d84-986e-754913029373', None, None, None, None, None)] {{(pid=120876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 21:08:58.698255 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-edfb91c1-1646-4128-bfd0-65e3fa240f0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.640762 Aug 19 21:08:58.699477 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 41/74] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Aug 19 21:08:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 1643 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 19 21:08:58.709442 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e0cef7e5-37fb-42c6-ad28-3e977869fb57 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:58.710740 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-e0cef7e5-37fb-42c6-ad28-3e977869fb57 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:58.734648 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e0cef7e5-37fb-42c6-ad28-3e977869fb57 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:58.740911 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e0cef7e5-37fb-42c6-ad28-3e977869fb57 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:58.741107 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e0cef7e5-37fb-42c6-ad28-3e977869fb57 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:58.743639 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e0cef7e5-37fb-42c6-ad28-3e977869fb57 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:58.746167 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e0cef7e5-37fb-42c6-ad28-3e977869fb57 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:58.750414 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e0cef7e5-37fb-42c6-ad28-3e977869fb57 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:58.973691 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e0cef7e5-37fb-42c6-ad28-3e977869fb57 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:59.004438 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e0cef7e5-37fb-42c6-ad28-3e977869fb57 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1246 microversion: 2.1 time: 0.302777 Aug 19 21:08:59.006276 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 42/75] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:58 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1246 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:59.028961 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0b96648c-11a9-46c5-b59d-bf2506834421 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:59.031305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0b96648c-11a9-46c5-b59d-bf2506834421 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:59.191402 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0b96648c-11a9-46c5-b59d-bf2506834421 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:59.212771 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0b96648c-11a9-46c5-b59d-bf2506834421 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:59.217417 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0b96648c-11a9-46c5-b59d-bf2506834421 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:59.221067 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0b96648c-11a9-46c5-b59d-bf2506834421 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1281 microversion: 2.20 time: 0.212044 Aug 19 21:08:59.223239 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 43/76] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:08:59 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1281 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:08:59.248047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-4b78fa4f-1c3f-4d93-ad4b-052b926b9aab tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:59.248599 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-4b78fa4f-1c3f-4d93-ad4b-052b926b9aab tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:59.258157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4b78fa4f-1c3f-4d93-ad4b-052b926b9aab tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:59.258674 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4b78fa4f-1c3f-4d93-ad4b-052b926b9aab tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:59.259332 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4b78fa4f-1c3f-4d93-ad4b-052b926b9aab tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:59.260839 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4b78fa4f-1c3f-4d93-ad4b-052b926b9aab tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:59.261937 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4b78fa4f-1c3f-4d93-ad4b-052b926b9aab tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:59.262751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4b78fa4f-1c3f-4d93-ad4b-052b926b9aab tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:59.687809 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-4b78fa4f-1c3f-4d93-ad4b-052b926b9aab tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:59.698930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-4b78fa4f-1c3f-4d93-ad4b-052b926b9aab tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1321 microversion: 2.1 time: 0.469372 Aug 19 21:08:59.700131 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 44/77] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:59 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1321 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:08:59.706165 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-7a348d02-afaa-49be-8719-e9eddf04b7f7 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:08:59.706983 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-7a348d02-afaa-49be-8719-e9eddf04b7f7 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:08:59.720427 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7a348d02-afaa-49be-8719-e9eddf04b7f7 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:59.722683 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7a348d02-afaa-49be-8719-e9eddf04b7f7 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:59.723466 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7a348d02-afaa-49be-8719-e9eddf04b7f7 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:59.726168 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7a348d02-afaa-49be-8719-e9eddf04b7f7 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:59.727007 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7a348d02-afaa-49be-8719-e9eddf04b7f7 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:59.727811 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7a348d02-afaa-49be-8719-e9eddf04b7f7 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:59.872067 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-15ae7ad5-4c0f-483f-a028-e9e4d685bbfb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Flavor limits 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 21:08:59.873138 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-15ae7ad5-4c0f-483f-a028-e9e4d685bbfb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Image limits 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 21:08:59.873686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-15ae7ad5-4c0f-483f-a028-e9e4d685bbfb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Flavor pref 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 21:08:59.874333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-15ae7ad5-4c0f-483f-a028-e9e4d685bbfb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Image pref 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 21:08:59.874762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-15ae7ad5-4c0f-483f-a028-e9e4d685bbfb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 21:08:59.888087 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-15ae7ad5-4c0f-483f-a028-e9e4d685bbfb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:59.889359 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-15ae7ad5-4c0f-483f-a028-e9e4d685bbfb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:59.890012 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-15ae7ad5-4c0f-483f-a028-e9e4d685bbfb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:59.891163 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-15ae7ad5-4c0f-483f-a028-e9e4d685bbfb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:08:59.892706 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-15ae7ad5-4c0f-483f-a028-e9e4d685bbfb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:08:59.893696 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-15ae7ad5-4c0f-483f-a028-e9e4d685bbfb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:08:59.920924 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-15ae7ad5-4c0f-483f-a028-e9e4d685bbfb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Getting quotas for project def1895e8f3b40f1b608240c60a0066a. Resources: {'cores', 'ram', 'instances'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:08:59.926325 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-15ae7ad5-4c0f-483f-a028-e9e4d685bbfb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Getting quotas for user 8810b3e211d448cea9a506d9183dc13d and project def1895e8f3b40f1b608240c60a0066a. Resources: {'cores', 'ram', 'instances'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:08:59.941930 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-15ae7ad5-4c0f-483f-a028-e9e4d685bbfb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Going to run 1 instances... {{(pid=120876) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 21:08:59.945601 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-15ae7ad5-4c0f-483f-a028-e9e4d685bbfb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f034cf-f103-477b-bbb5-3298c678db05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 21:08:59.968360 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-7a348d02-afaa-49be-8719-e9eddf04b7f7 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:08:59.980160 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-7a348d02-afaa-49be-8719-e9eddf04b7f7 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1315 microversion: 2.1 time: 0.278610 Aug 19 21:08:59.981318 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 45/78] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:08:59 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:00.002975 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-15ae7ad5-4c0f-483f-a028-e9e4d685bbfb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.454380 Aug 19 21:09:00.010771 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 34/79] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Aug 19 21:08:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 1457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 21:09:00.016359 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8bbd2c53-b3b7-4662-94c8-cd9b322c27b4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:00.016981 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8bbd2c53-b3b7-4662-94c8-cd9b322c27b4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:00.034621 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-96c12bdf-1183-4deb-a3e1-259260871669 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:00.035800 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-96c12bdf-1183-4deb-a3e1-259260871669 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:00.049395 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-96c12bdf-1183-4deb-a3e1-259260871669 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:00.050501 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-96c12bdf-1183-4deb-a3e1-259260871669 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:00.052056 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-96c12bdf-1183-4deb-a3e1-259260871669 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:00.053431 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-96c12bdf-1183-4deb-a3e1-259260871669 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:00.053863 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-96c12bdf-1183-4deb-a3e1-259260871669 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:00.054310 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-96c12bdf-1183-4deb-a3e1-259260871669 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:00.120249 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8bbd2c53-b3b7-4662-94c8-cd9b322c27b4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:00.131757 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8bbd2c53-b3b7-4662-94c8-cd9b322c27b4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1238 microversion: 2.1 time: 0.119039 Aug 19 21:09:00.132758 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 46/80] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:00 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1238 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:00.194072 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-96c12bdf-1183-4deb-a3e1-259260871669 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:00.208311 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-96c12bdf-1183-4deb-a3e1-259260871669 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1246 microversion: 2.1 time: 0.182986 Aug 19 21:09:00.209711 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 35/81] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:00 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1246 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:00.259278 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-33483f4b-78a6-494b-ba19-5c29cdca3411 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:00.261429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-33483f4b-78a6-494b-ba19-5c29cdca3411 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:00.276613 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-33483f4b-78a6-494b-ba19-5c29cdca3411 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:00.277071 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-33483f4b-78a6-494b-ba19-5c29cdca3411 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:00.277602 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-33483f4b-78a6-494b-ba19-5c29cdca3411 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:00.290775 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-33483f4b-78a6-494b-ba19-5c29cdca3411 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:00.291576 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-33483f4b-78a6-494b-ba19-5c29cdca3411 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:00.292253 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-33483f4b-78a6-494b-ba19-5c29cdca3411 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:00.728406 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-2b18fabe-bd06-4128-859e-08f3b4f9b351 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:00.743702 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-2b18fabe-bd06-4128-859e-08f3b4f9b351 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:00.752942 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-33483f4b-78a6-494b-ba19-5c29cdca3411 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:00.767113 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2b18fabe-bd06-4128-859e-08f3b4f9b351 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:00.768323 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2b18fabe-bd06-4128-859e-08f3b4f9b351 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:00.774532 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2b18fabe-bd06-4128-859e-08f3b4f9b351 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:00.776362 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2b18fabe-bd06-4128-859e-08f3b4f9b351 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:00.777234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2b18fabe-bd06-4128-859e-08f3b4f9b351 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:00.779952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-33483f4b-78a6-494b-ba19-5c29cdca3411 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:00.782465 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2b18fabe-bd06-4128-859e-08f3b4f9b351 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:00.788017 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-33483f4b-78a6-494b-ba19-5c29cdca3411 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:00.800880 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-33483f4b-78a6-494b-ba19-5c29cdca3411 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1285 microversion: 2.20 time: 0.546890 Aug 19 21:09:00.801834 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 47/82] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:00 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1285 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:09:01.008558 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-650f93e7-61ed-435d-8647-ea5d832d026b tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:01.012841 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-650f93e7-61ed-435d-8647-ea5d832d026b tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:01.046504 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-650f93e7-61ed-435d-8647-ea5d832d026b tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:01.047528 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-650f93e7-61ed-435d-8647-ea5d832d026b tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:01.059394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-650f93e7-61ed-435d-8647-ea5d832d026b tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:01.060932 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-650f93e7-61ed-435d-8647-ea5d832d026b tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:01.061817 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-650f93e7-61ed-435d-8647-ea5d832d026b tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:01.062620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-650f93e7-61ed-435d-8647-ea5d832d026b tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:01.412954 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-2b18fabe-bd06-4128-859e-08f3b4f9b351 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:01.435239 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-2b18fabe-bd06-4128-859e-08f3b4f9b351 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1321 microversion: 2.1 time: 0.717911 Aug 19 21:09:01.438262 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 36/83] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:00 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1321 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:01.449146 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-40c90a79-ad55-4b37-b6b0-f65fa91fbcce tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:01.450229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-40c90a79-ad55-4b37-b6b0-f65fa91fbcce tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:01.461542 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-40c90a79-ad55-4b37-b6b0-f65fa91fbcce tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:01.462597 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-40c90a79-ad55-4b37-b6b0-f65fa91fbcce tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:01.463366 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-40c90a79-ad55-4b37-b6b0-f65fa91fbcce tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:01.464760 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-40c90a79-ad55-4b37-b6b0-f65fa91fbcce tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:01.465791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-40c90a79-ad55-4b37-b6b0-f65fa91fbcce tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:01.466723 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-40c90a79-ad55-4b37-b6b0-f65fa91fbcce tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:01.494385 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-650f93e7-61ed-435d-8647-ea5d832d026b tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:01.507673 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-650f93e7-61ed-435d-8647-ea5d832d026b tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1315 microversion: 2.1 time: 0.506629 Aug 19 21:09:01.508438 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 48/84] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:00 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:01.525073 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-fb7f5d10-4964-4ae3-aa14-199628d6750c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:01.525967 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-fb7f5d10-4964-4ae3-aa14-199628d6750c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:01.539934 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fb7f5d10-4964-4ae3-aa14-199628d6750c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:01.540623 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fb7f5d10-4964-4ae3-aa14-199628d6750c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:01.541084 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fb7f5d10-4964-4ae3-aa14-199628d6750c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:01.541986 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fb7f5d10-4964-4ae3-aa14-199628d6750c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:01.542580 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fb7f5d10-4964-4ae3-aa14-199628d6750c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:01.543189 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fb7f5d10-4964-4ae3-aa14-199628d6750c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:01.604482 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-40c90a79-ad55-4b37-b6b0-f65fa91fbcce tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:01.638876 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-40c90a79-ad55-4b37-b6b0-f65fa91fbcce tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1242 microversion: 2.1 time: 0.198388 Aug 19 21:09:01.640227 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 37/85] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:01 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1242 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:01.657189 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-fb7f5d10-4964-4ae3-aa14-199628d6750c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:01.668684 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-fb7f5d10-4964-4ae3-aa14-199628d6750c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1294 microversion: 2.1 time: 0.159146 Aug 19 21:09:01.669453 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 49/86] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:01 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1294 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:01.858543 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-b9219aeb-4973-4361-a638-dbdc2ac215fe tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:01.859697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-b9219aeb-4973-4361-a638-dbdc2ac215fe tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:01.874614 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b9219aeb-4973-4361-a638-dbdc2ac215fe tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:01.875512 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b9219aeb-4973-4361-a638-dbdc2ac215fe tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:01.876376 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b9219aeb-4973-4361-a638-dbdc2ac215fe tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:01.878074 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b9219aeb-4973-4361-a638-dbdc2ac215fe tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:01.879063 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b9219aeb-4973-4361-a638-dbdc2ac215fe tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:01.880088 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b9219aeb-4973-4361-a638-dbdc2ac215fe tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:01.993561 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b9219aeb-4973-4361-a638-dbdc2ac215fe tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:02.009316 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b9219aeb-4973-4361-a638-dbdc2ac215fe tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:02.012338 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b9219aeb-4973-4361-a638-dbdc2ac215fe tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:02.014635 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-b9219aeb-4973-4361-a638-dbdc2ac215fe tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1333 microversion: 2.20 time: 0.164165 Aug 19 21:09:02.016069 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 38/87] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:01 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1333 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:09:02.463103 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0c4b3346-346b-4894-abcd-9e4b9e76721d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:02.464128 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0c4b3346-346b-4894-abcd-9e4b9e76721d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:02.472555 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0c4b3346-346b-4894-abcd-9e4b9e76721d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:02.473159 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0c4b3346-346b-4894-abcd-9e4b9e76721d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:02.473793 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0c4b3346-346b-4894-abcd-9e4b9e76721d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:02.474661 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0c4b3346-346b-4894-abcd-9e4b9e76721d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:02.475443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0c4b3346-346b-4894-abcd-9e4b9e76721d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:02.476057 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0c4b3346-346b-4894-abcd-9e4b9e76721d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:02.545190 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-a0efdd5f-c3c0-4b2e-8e9d-2dc11de7cae8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:02.546554 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-a0efdd5f-c3c0-4b2e-8e9d-2dc11de7cae8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:02.558355 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a0efdd5f-c3c0-4b2e-8e9d-2dc11de7cae8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:02.559565 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a0efdd5f-c3c0-4b2e-8e9d-2dc11de7cae8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:02.560640 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a0efdd5f-c3c0-4b2e-8e9d-2dc11de7cae8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:02.562607 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a0efdd5f-c3c0-4b2e-8e9d-2dc11de7cae8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:02.563288 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a0efdd5f-c3c0-4b2e-8e9d-2dc11de7cae8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:02.564173 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a0efdd5f-c3c0-4b2e-8e9d-2dc11de7cae8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:02.767705 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0c4b3346-346b-4894-abcd-9e4b9e76721d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:02.785922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0c4b3346-346b-4894-abcd-9e4b9e76721d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1321 microversion: 2.1 time: 0.327320 Aug 19 21:09:02.788298 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 50/88] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:02 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:02.800081 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ebb27f53-9eda-40a1-859c-4cbb8bca8161 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:02.801296 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ebb27f53-9eda-40a1-859c-4cbb8bca8161 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:02.815982 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ebb27f53-9eda-40a1-859c-4cbb8bca8161 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:02.818952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ebb27f53-9eda-40a1-859c-4cbb8bca8161 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:02.820184 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ebb27f53-9eda-40a1-859c-4cbb8bca8161 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:02.834860 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ebb27f53-9eda-40a1-859c-4cbb8bca8161 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:02.837690 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ebb27f53-9eda-40a1-859c-4cbb8bca8161 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:02.841257 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ebb27f53-9eda-40a1-859c-4cbb8bca8161 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:03.110601 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-a0efdd5f-c3c0-4b2e-8e9d-2dc11de7cae8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:03.131224 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-a0efdd5f-c3c0-4b2e-8e9d-2dc11de7cae8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1315 microversion: 2.1 time: 0.592703 Aug 19 21:09:03.133591 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 39/89] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:02 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1315 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:03.157305 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d03575bc-3ddf-4092-8f4a-588b3928a5f7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:03.158905 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-d03575bc-3ddf-4092-8f4a-588b3928a5f7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:03.179655 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d03575bc-3ddf-4092-8f4a-588b3928a5f7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:03.180884 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d03575bc-3ddf-4092-8f4a-588b3928a5f7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:03.182025 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d03575bc-3ddf-4092-8f4a-588b3928a5f7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:03.183612 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d03575bc-3ddf-4092-8f4a-588b3928a5f7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:03.184780 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d03575bc-3ddf-4092-8f4a-588b3928a5f7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:03.187402 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d03575bc-3ddf-4092-8f4a-588b3928a5f7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:03.309460 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ebb27f53-9eda-40a1-859c-4cbb8bca8161 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:03.337819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ebb27f53-9eda-40a1-859c-4cbb8bca8161 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1242 microversion: 2.1 time: 0.547026 Aug 19 21:09:03.344648 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 51/90] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:02 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1242 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:03.359408 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-86018a60-0237-4390-abe8-0873174e78e7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:03.360875 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-86018a60-0237-4390-abe8-0873174e78e7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:03.431346 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-86018a60-0237-4390-abe8-0873174e78e7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:03.432217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-86018a60-0237-4390-abe8-0873174e78e7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:03.433005 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-86018a60-0237-4390-abe8-0873174e78e7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:03.450584 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-86018a60-0237-4390-abe8-0873174e78e7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:03.455337 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-86018a60-0237-4390-abe8-0873174e78e7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:03.462742 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-86018a60-0237-4390-abe8-0873174e78e7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:03.511957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-d03575bc-3ddf-4092-8f4a-588b3928a5f7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:03.530816 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-d03575bc-3ddf-4092-8f4a-588b3928a5f7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1294 microversion: 2.1 time: 0.395024 Aug 19 21:09:03.531459 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 40/91] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:03 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1294 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:03.742161 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-86018a60-0237-4390-abe8-0873174e78e7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:03.777438 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-86018a60-0237-4390-abe8-0873174e78e7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:03.788687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-86018a60-0237-4390-abe8-0873174e78e7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:03.791059 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-86018a60-0237-4390-abe8-0873174e78e7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1333 microversion: 2.20 time: 0.442005 Aug 19 21:09:03.797224 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 52/92] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:03 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1333 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:09:03.831126 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d8950d6b-80f8-42ef-958f-8d4d42916617 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:03.834314 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-d8950d6b-80f8-42ef-958f-8d4d42916617 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:03.858797 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d8950d6b-80f8-42ef-958f-8d4d42916617 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:03.859320 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d8950d6b-80f8-42ef-958f-8d4d42916617 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:03.871577 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d8950d6b-80f8-42ef-958f-8d4d42916617 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:03.875377 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d8950d6b-80f8-42ef-958f-8d4d42916617 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:03.878718 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d8950d6b-80f8-42ef-958f-8d4d42916617 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:03.882534 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d8950d6b-80f8-42ef-958f-8d4d42916617 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:04.358349 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-d20dcec2-a21a-4768-908f-20ffccc05371 req-2a3dd375-145f-4e7c-a5cf-707cbd1cd7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e363b06b-e5dd-48c8-a0d8-afdfa5bad759", "name": "network-vif-plugged", "status": "completed", "tag": "851487e1-a850-4116-9209-d8a95dd86a4e"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:09:04.404642 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-d20dcec2-a21a-4768-908f-20ffccc05371 req-2a3dd375-145f-4e7c-a5cf-707cbd1cd7a1 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:04.405433 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-d20dcec2-a21a-4768-908f-20ffccc05371 req-2a3dd375-145f-4e7c-a5cf-707cbd1cd7a1 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:04.406290 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-d20dcec2-a21a-4768-908f-20ffccc05371 req-2a3dd375-145f-4e7c-a5cf-707cbd1cd7a1 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:04.433254 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-d20dcec2-a21a-4768-908f-20ffccc05371 req-2a3dd375-145f-4e7c-a5cf-707cbd1cd7a1 service nova] Creating event network-vif-plugged:851487e1-a850-4116-9209-d8a95dd86a4e for instance e363b06b-e5dd-48c8-a0d8-afdfa5bad759 on hv-cinder-85220 Aug 19 21:09:04.450772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-d20dcec2-a21a-4768-908f-20ffccc05371 req-2a3dd375-145f-4e7c-a5cf-707cbd1cd7a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.481396 Aug 19 21:09:04.451805 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 53/93] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:09:04.467664 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c8f297a8-2d3b-45d9-82e1-6e0a5c2bca87 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:04.468374 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-c8f297a8-2d3b-45d9-82e1-6e0a5c2bca87 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:04.489843 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c8f297a8-2d3b-45d9-82e1-6e0a5c2bca87 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:04.490436 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c8f297a8-2d3b-45d9-82e1-6e0a5c2bca87 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:04.491223 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c8f297a8-2d3b-45d9-82e1-6e0a5c2bca87 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:04.491999 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c8f297a8-2d3b-45d9-82e1-6e0a5c2bca87 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:04.499643 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c8f297a8-2d3b-45d9-82e1-6e0a5c2bca87 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:04.500204 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c8f297a8-2d3b-45d9-82e1-6e0a5c2bca87 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:05.481652 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-d8950d6b-80f8-42ef-958f-8d4d42916617 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:05.491593 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-d8950d6b-80f8-42ef-958f-8d4d42916617 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1321 microversion: 2.1 time: 1.667531 Aug 19 21:09:05.492248 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 41/94] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:03 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1321 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:05.510179 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-5b379819-a1c9-4f62-9901-7590be2aa4b4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:05.511071 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-5b379819-a1c9-4f62-9901-7590be2aa4b4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:05.518712 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5b379819-a1c9-4f62-9901-7590be2aa4b4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:05.519488 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5b379819-a1c9-4f62-9901-7590be2aa4b4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:05.520136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5b379819-a1c9-4f62-9901-7590be2aa4b4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:05.521074 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5b379819-a1c9-4f62-9901-7590be2aa4b4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:05.522336 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5b379819-a1c9-4f62-9901-7590be2aa4b4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:05.523145 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5b379819-a1c9-4f62-9901-7590be2aa4b4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:05.749088 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c8f297a8-2d3b-45d9-82e1-6e0a5c2bca87 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:05.787732 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-c8f297a8-2d3b-45d9-82e1-6e0a5c2bca87 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1315 microversion: 2.1 time: 1.333372 Aug 19 21:09:05.813023 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 54/95] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:04 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1315 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:05.848942 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-eeb6ea4d-4c8a-4d1b-b7c5-11463a50092f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:05.851124 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-eeb6ea4d-4c8a-4d1b-b7c5-11463a50092f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:05.867092 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eeb6ea4d-4c8a-4d1b-b7c5-11463a50092f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:05.868062 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eeb6ea4d-4c8a-4d1b-b7c5-11463a50092f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:05.870312 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eeb6ea4d-4c8a-4d1b-b7c5-11463a50092f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:05.871628 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eeb6ea4d-4c8a-4d1b-b7c5-11463a50092f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:05.873311 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eeb6ea4d-4c8a-4d1b-b7c5-11463a50092f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:05.874172 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eeb6ea4d-4c8a-4d1b-b7c5-11463a50092f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:06.034686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-5b379819-a1c9-4f62-9901-7590be2aa4b4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:06.055747 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-5b379819-a1c9-4f62-9901-7590be2aa4b4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1296 microversion: 2.1 time: 0.549265 Aug 19 21:09:06.059299 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 42/96] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:05 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1296 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:06.076360 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-9ada8a7c-88d1-4bbe-89e2-d44f4696e9b3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:06.077147 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-9ada8a7c-88d1-4bbe-89e2-d44f4696e9b3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:06.091785 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9ada8a7c-88d1-4bbe-89e2-d44f4696e9b3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:06.092300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9ada8a7c-88d1-4bbe-89e2-d44f4696e9b3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:06.092745 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9ada8a7c-88d1-4bbe-89e2-d44f4696e9b3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:06.093603 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9ada8a7c-88d1-4bbe-89e2-d44f4696e9b3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:06.094122 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9ada8a7c-88d1-4bbe-89e2-d44f4696e9b3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:06.094555 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9ada8a7c-88d1-4bbe-89e2-d44f4696e9b3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:06.126169 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=100 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:06.263487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-eeb6ea4d-4c8a-4d1b-b7c5-11463a50092f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:06.284820 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-eeb6ea4d-4c8a-4d1b-b7c5-11463a50092f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1300 microversion: 2.1 time: 0.460593 Aug 19 21:09:06.286991 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 55/97] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:05 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1300 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:06.302744 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9ada8a7c-88d1-4bbe-89e2-d44f4696e9b3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:06.324957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9ada8a7c-88d1-4bbe-89e2-d44f4696e9b3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:06.328730 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9ada8a7c-88d1-4bbe-89e2-d44f4696e9b3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:06.336867 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-9ada8a7c-88d1-4bbe-89e2-d44f4696e9b3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1339 microversion: 2.20 time: 0.274689 Aug 19 21:09:06.341494 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 43/98] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:06 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1339 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:09:06.515229 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-420a0ba3-4c84-4a86-86c1-82397149f8a5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:06.516052 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-420a0ba3-4c84-4a86-86c1-82397149f8a5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:06.529947 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-420a0ba3-4c84-4a86-86c1-82397149f8a5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:06.530648 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-420a0ba3-4c84-4a86-86c1-82397149f8a5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:06.540981 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-420a0ba3-4c84-4a86-86c1-82397149f8a5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:06.542423 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-420a0ba3-4c84-4a86-86c1-82397149f8a5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:06.548854 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-420a0ba3-4c84-4a86-86c1-82397149f8a5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:06.549598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-420a0ba3-4c84-4a86-86c1-82397149f8a5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:06.856359 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-fbdaa159-fbfb-45cd-a04d-95fda97be2aa tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:06.857533 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-fbdaa159-fbfb-45cd-a04d-95fda97be2aa tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:06.897721 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fbdaa159-fbfb-45cd-a04d-95fda97be2aa tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:06.898977 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fbdaa159-fbfb-45cd-a04d-95fda97be2aa tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:06.902418 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fbdaa159-fbfb-45cd-a04d-95fda97be2aa tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:06.905379 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fbdaa159-fbfb-45cd-a04d-95fda97be2aa tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:06.906424 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fbdaa159-fbfb-45cd-a04d-95fda97be2aa tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:06.907678 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fbdaa159-fbfb-45cd-a04d-95fda97be2aa tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:07.204563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-420a0ba3-4c84-4a86-86c1-82397149f8a5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:07.221245 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-420a0ba3-4c84-4a86-86c1-82397149f8a5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1321 microversion: 2.1 time: 0.711970 Aug 19 21:09:07.235445 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 56/99] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:06 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1321 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:07.241292 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3667bd3d-26c2-4b90-8344-e4ecbb899966 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:07.242026 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-3667bd3d-26c2-4b90-8344-e4ecbb899966 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:07.257002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3667bd3d-26c2-4b90-8344-e4ecbb899966 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:07.257513 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3667bd3d-26c2-4b90-8344-e4ecbb899966 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:07.257994 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3667bd3d-26c2-4b90-8344-e4ecbb899966 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:07.263528 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3667bd3d-26c2-4b90-8344-e4ecbb899966 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:07.264021 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3667bd3d-26c2-4b90-8344-e4ecbb899966 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:07.270558 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3667bd3d-26c2-4b90-8344-e4ecbb899966 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:07.535504 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-fbdaa159-fbfb-45cd-a04d-95fda97be2aa tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:07.580862 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-fbdaa159-fbfb-45cd-a04d-95fda97be2aa tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1315 microversion: 2.1 time: 0.721591 Aug 19 21:09:07.582405 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 44/100] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:06 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1315 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:07.603955 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-472ab4bc-8693-4dac-a2d3-020e9447ab90 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:07.606315 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-472ab4bc-8693-4dac-a2d3-020e9447ab90 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:07.621585 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-472ab4bc-8693-4dac-a2d3-020e9447ab90 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:07.628744 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-472ab4bc-8693-4dac-a2d3-020e9447ab90 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:07.630612 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-472ab4bc-8693-4dac-a2d3-020e9447ab90 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:07.632721 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-472ab4bc-8693-4dac-a2d3-020e9447ab90 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:07.633793 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-472ab4bc-8693-4dac-a2d3-020e9447ab90 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:07.634780 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-472ab4bc-8693-4dac-a2d3-020e9447ab90 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:08.053288 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3667bd3d-26c2-4b90-8344-e4ecbb899966 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:08.073683 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-3667bd3d-26c2-4b90-8344-e4ecbb899966 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1363 microversion: 2.1 time: 0.834951 Aug 19 21:09:08.075222 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 57/101] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:07 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1363 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:08.083183 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-76c9b32e-fc42-45c8-9c32-a119c7e8fdd8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:08.085004 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-76c9b32e-fc42-45c8-9c32-a119c7e8fdd8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:08.131405 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-76c9b32e-fc42-45c8-9c32-a119c7e8fdd8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:08.134456 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-76c9b32e-fc42-45c8-9c32-a119c7e8fdd8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:08.136830 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-76c9b32e-fc42-45c8-9c32-a119c7e8fdd8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:08.137955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-76c9b32e-fc42-45c8-9c32-a119c7e8fdd8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:08.141836 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-76c9b32e-fc42-45c8-9c32-a119c7e8fdd8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:08.142566 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-76c9b32e-fc42-45c8-9c32-a119c7e8fdd8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:08.273131 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-76c9b32e-fc42-45c8-9c32-a119c7e8fdd8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:08.277817 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-472ab4bc-8693-4dac-a2d3-020e9447ab90 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:08.290047 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-472ab4bc-8693-4dac-a2d3-020e9447ab90 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1368 microversion: 2.1 time: 0.705704 Aug 19 21:09:08.293210 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 45/102] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:07 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1368 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:08.307119 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-76c9b32e-fc42-45c8-9c32-a119c7e8fdd8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:08.313782 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-76c9b32e-fc42-45c8-9c32-a119c7e8fdd8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:08.315663 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-76c9b32e-fc42-45c8-9c32-a119c7e8fdd8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1339 microversion: 2.20 time: 0.238307 Aug 19 21:09:08.315985 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-700130f0-03e8-40e0-b8f0-34b8b1ce69e3 req-a3c0acdb-c3d7-47e4-b9e0-8f2f219f6006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeac61e2-44ff-4477-94da-a109f4907096", "name": "network-vif-plugged", "status": "completed", "tag": "554843a8-960c-4d22-858b-254efc47fd8c"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:09:08.317488 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 58/103] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:08 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1339 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:09:08.338831 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c4e50570-b381-44ea-8c7d-da60fa3c243f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:08.346387 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-c4e50570-b381-44ea-8c7d-da60fa3c243f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:08.351182 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-700130f0-03e8-40e0-b8f0-34b8b1ce69e3 req-a3c0acdb-c3d7-47e4-b9e0-8f2f219f6006 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:08.356055 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-700130f0-03e8-40e0-b8f0-34b8b1ce69e3 req-a3c0acdb-c3d7-47e4-b9e0-8f2f219f6006 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:08.356673 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-700130f0-03e8-40e0-b8f0-34b8b1ce69e3 req-a3c0acdb-c3d7-47e4-b9e0-8f2f219f6006 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:08.368862 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c4e50570-b381-44ea-8c7d-da60fa3c243f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:08.369713 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c4e50570-b381-44ea-8c7d-da60fa3c243f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:08.370505 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c4e50570-b381-44ea-8c7d-da60fa3c243f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:08.371585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c4e50570-b381-44ea-8c7d-da60fa3c243f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:08.372409 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c4e50570-b381-44ea-8c7d-da60fa3c243f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:08.383576 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c4e50570-b381-44ea-8c7d-da60fa3c243f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:08.384309 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-700130f0-03e8-40e0-b8f0-34b8b1ce69e3 req-a3c0acdb-c3d7-47e4-b9e0-8f2f219f6006 service nova] Creating event network-vif-plugged:554843a8-960c-4d22-858b-254efc47fd8c for instance eeac61e2-44ff-4477-94da-a109f4907096 on hv-cinder-85220 Aug 19 21:09:08.403331 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-700130f0-03e8-40e0-b8f0-34b8b1ce69e3 req-a3c0acdb-c3d7-47e4-b9e0-8f2f219f6006 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108042 Aug 19 21:09:08.404777 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 46/104] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:09:08.548612 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=6 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:08.605015 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-8a22c1ea-088b-449d-a155-d6fd1ce93b9f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:08.605973 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-8a22c1ea-088b-449d-a155-d6fd1ce93b9f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:08.620680 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8a22c1ea-088b-449d-a155-d6fd1ce93b9f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:08.621465 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8a22c1ea-088b-449d-a155-d6fd1ce93b9f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:08.622447 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8a22c1ea-088b-449d-a155-d6fd1ce93b9f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:08.625193 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8a22c1ea-088b-449d-a155-d6fd1ce93b9f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:08.627805 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8a22c1ea-088b-449d-a155-d6fd1ce93b9f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:08.628472 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8a22c1ea-088b-449d-a155-d6fd1ce93b9f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:08.874747 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c4e50570-b381-44ea-8c7d-da60fa3c243f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:08.913378 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-c4e50570-b381-44ea-8c7d-da60fa3c243f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1321 microversion: 2.1 time: 0.590792 Aug 19 21:09:08.952315 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 59/105] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:08 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1321 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:08.997412 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-8a22c1ea-088b-449d-a155-d6fd1ce93b9f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:09.007603 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-8a22c1ea-088b-449d-a155-d6fd1ce93b9f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1315 microversion: 2.1 time: 0.407736 Aug 19 21:09:09.008207 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 47/106] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:08 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:09.113077 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-eb00c450-a97d-49d4-b35e-c22091cb0c96 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:09.113711 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-eb00c450-a97d-49d4-b35e-c22091cb0c96 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:09.124691 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eb00c450-a97d-49d4-b35e-c22091cb0c96 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:09.126289 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eb00c450-a97d-49d4-b35e-c22091cb0c96 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:09.128381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eb00c450-a97d-49d4-b35e-c22091cb0c96 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:09.130079 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eb00c450-a97d-49d4-b35e-c22091cb0c96 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:09.131058 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eb00c450-a97d-49d4-b35e-c22091cb0c96 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:09.132054 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eb00c450-a97d-49d4-b35e-c22091cb0c96 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:09.329732 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-7f7eb854-7186-4e58-895a-3e4e94b6c769 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:09.331190 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-7f7eb854-7186-4e58-895a-3e4e94b6c769 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:09.339516 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7f7eb854-7186-4e58-895a-3e4e94b6c769 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:09.340416 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7f7eb854-7186-4e58-895a-3e4e94b6c769 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:09.341028 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7f7eb854-7186-4e58-895a-3e4e94b6c769 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:09.341794 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7f7eb854-7186-4e58-895a-3e4e94b6c769 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:09.342517 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7f7eb854-7186-4e58-895a-3e4e94b6c769 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:09.343139 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7f7eb854-7186-4e58-895a-3e4e94b6c769 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:09.379700 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-eb00c450-a97d-49d4-b35e-c22091cb0c96 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:09.388953 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=100 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:09.397489 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-eb00c450-a97d-49d4-b35e-c22091cb0c96 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1363 microversion: 2.1 time: 0.287757 Aug 19 21:09:09.398187 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 60/107] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:09 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1363 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:09.403162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ea4ea286-4fbb-4e95-a88c-61d422097f0b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:09.414531 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ea4ea286-4fbb-4e95-a88c-61d422097f0b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:09.433260 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea4ea286-4fbb-4e95-a88c-61d422097f0b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:09.433966 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea4ea286-4fbb-4e95-a88c-61d422097f0b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:09.434648 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea4ea286-4fbb-4e95-a88c-61d422097f0b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:09.435562 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea4ea286-4fbb-4e95-a88c-61d422097f0b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:09.436959 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea4ea286-4fbb-4e95-a88c-61d422097f0b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:09.437725 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea4ea286-4fbb-4e95-a88c-61d422097f0b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:09.665633 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-7f7eb854-7186-4e58-895a-3e4e94b6c769 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:09.681076 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-7f7eb854-7186-4e58-895a-3e4e94b6c769 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1368 microversion: 2.1 time: 0.359015 Aug 19 21:09:09.699630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 48/108] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:09 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1368 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:09.745933 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ea4ea286-4fbb-4e95-a88c-61d422097f0b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:09.757105 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ea4ea286-4fbb-4e95-a88c-61d422097f0b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:09.759269 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ea4ea286-4fbb-4e95-a88c-61d422097f0b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:09.760807 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ea4ea286-4fbb-4e95-a88c-61d422097f0b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1406 microversion: 2.20 time: 0.361521 Aug 19 21:09:09.761862 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 61/109] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:09 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1406 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:09:09.955391 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-23a7a8d2-946e-4345-9dfc-3671dcfa4975 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:09.955391 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-23a7a8d2-946e-4345-9dfc-3671dcfa4975 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:09.957457 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=4 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:09.958223 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=8 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:09.974649 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-23a7a8d2-946e-4345-9dfc-3671dcfa4975 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:09.975379 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-23a7a8d2-946e-4345-9dfc-3671dcfa4975 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:09.976079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-23a7a8d2-946e-4345-9dfc-3671dcfa4975 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:09.977090 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-23a7a8d2-946e-4345-9dfc-3671dcfa4975 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:09.977651 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-23a7a8d2-946e-4345-9dfc-3671dcfa4975 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:09.978349 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-23a7a8d2-946e-4345-9dfc-3671dcfa4975 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:10.028764 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ebd34b4d-00c7-4657-b963-826f9eaf29f4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:10.029729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ebd34b4d-00c7-4657-b963-826f9eaf29f4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:10.037263 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ebd34b4d-00c7-4657-b963-826f9eaf29f4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:10.038545 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ebd34b4d-00c7-4657-b963-826f9eaf29f4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:10.038996 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ebd34b4d-00c7-4657-b963-826f9eaf29f4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:10.039774 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ebd34b4d-00c7-4657-b963-826f9eaf29f4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:10.040595 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ebd34b4d-00c7-4657-b963-826f9eaf29f4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:10.041480 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ebd34b4d-00c7-4657-b963-826f9eaf29f4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:10.125501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=20 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:10.386524 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-23a7a8d2-946e-4345-9dfc-3671dcfa4975 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:10.404616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-23a7a8d2-946e-4345-9dfc-3671dcfa4975 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1321 microversion: 2.1 time: 0.454793 Aug 19 21:09:10.406585 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 49/110] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:09 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1321 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:10.435922 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-fe57a2e2-6d66-4ef8-a0c0-2ba2d09278ba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:10.437746 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-fe57a2e2-6d66-4ef8-a0c0-2ba2d09278ba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:10.451030 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fe57a2e2-6d66-4ef8-a0c0-2ba2d09278ba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:10.452024 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fe57a2e2-6d66-4ef8-a0c0-2ba2d09278ba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:10.452798 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fe57a2e2-6d66-4ef8-a0c0-2ba2d09278ba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:10.454225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fe57a2e2-6d66-4ef8-a0c0-2ba2d09278ba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:10.455379 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fe57a2e2-6d66-4ef8-a0c0-2ba2d09278ba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:10.456273 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fe57a2e2-6d66-4ef8-a0c0-2ba2d09278ba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:10.473306 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ebd34b4d-00c7-4657-b963-826f9eaf29f4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:10.485568 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ebd34b4d-00c7-4657-b963-826f9eaf29f4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1315 microversion: 2.1 time: 0.460582 Aug 19 21:09:10.499548 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 62/111] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:10 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:10.702082 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-fe57a2e2-6d66-4ef8-a0c0-2ba2d09278ba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:10.714449 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-297ff252-b193-4458-98ea-9066e66dd631 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:10.715482 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-fe57a2e2-6d66-4ef8-a0c0-2ba2d09278ba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1363 microversion: 2.1 time: 0.287705 Aug 19 21:09:10.715761 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-297ff252-b193-4458-98ea-9066e66dd631 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:10.716326 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 50/112] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:10 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1363 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:10.719563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:10.723425 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-297ff252-b193-4458-98ea-9066e66dd631 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:10.723917 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-297ff252-b193-4458-98ea-9066e66dd631 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:10.724374 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-297ff252-b193-4458-98ea-9066e66dd631 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:10.725411 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-297ff252-b193-4458-98ea-9066e66dd631 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:10.725998 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-297ff252-b193-4458-98ea-9066e66dd631 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:10.726427 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-297ff252-b193-4458-98ea-9066e66dd631 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:10.804239 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-4b7b2ccc-0880-431c-8b51-2070ed62dcde tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:10.804916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-4b7b2ccc-0880-431c-8b51-2070ed62dcde tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:10.817493 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4b7b2ccc-0880-431c-8b51-2070ed62dcde tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:10.818235 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4b7b2ccc-0880-431c-8b51-2070ed62dcde tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:10.819208 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4b7b2ccc-0880-431c-8b51-2070ed62dcde tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:10.819961 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4b7b2ccc-0880-431c-8b51-2070ed62dcde tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:10.820430 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4b7b2ccc-0880-431c-8b51-2070ed62dcde tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:10.820854 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4b7b2ccc-0880-431c-8b51-2070ed62dcde tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:11.017347 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-297ff252-b193-4458-98ea-9066e66dd631 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:11.035689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-297ff252-b193-4458-98ea-9066e66dd631 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1368 microversion: 2.1 time: 0.324408 Aug 19 21:09:11.038776 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 63/113] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:10 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1368 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:11.078177 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-4b7b2ccc-0880-431c-8b51-2070ed62dcde tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:11.094038 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-4b7b2ccc-0880-431c-8b51-2070ed62dcde tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:11.098717 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-4b7b2ccc-0880-431c-8b51-2070ed62dcde tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:11.101546 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-4b7b2ccc-0880-431c-8b51-2070ed62dcde tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1406 microversion: 2.20 time: 0.301624 Aug 19 21:09:11.103308 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 51/114] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:10 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1406 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:09:11.428983 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-669d91fb-e576-471f-8c67-68a587d612f5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:11.430288 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-669d91fb-e576-471f-8c67-68a587d612f5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:11.438303 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-669d91fb-e576-471f-8c67-68a587d612f5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:11.438996 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-669d91fb-e576-471f-8c67-68a587d612f5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:11.439604 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-669d91fb-e576-471f-8c67-68a587d612f5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:11.440567 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-669d91fb-e576-471f-8c67-68a587d612f5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:11.441078 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-669d91fb-e576-471f-8c67-68a587d612f5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:11.441739 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-669d91fb-e576-471f-8c67-68a587d612f5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:11.517646 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-21147cb5-ebbb-4ab6-b803-ea27936ab1e9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:11.519151 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-21147cb5-ebbb-4ab6-b803-ea27936ab1e9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:11.530825 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-21147cb5-ebbb-4ab6-b803-ea27936ab1e9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:11.531896 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-21147cb5-ebbb-4ab6-b803-ea27936ab1e9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:11.532718 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-21147cb5-ebbb-4ab6-b803-ea27936ab1e9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:11.533792 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-21147cb5-ebbb-4ab6-b803-ea27936ab1e9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:11.534519 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-21147cb5-ebbb-4ab6-b803-ea27936ab1e9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:11.535152 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-21147cb5-ebbb-4ab6-b803-ea27936ab1e9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:11.764478 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-669d91fb-e576-471f-8c67-68a587d612f5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:11.769854 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-21147cb5-ebbb-4ab6-b803-ea27936ab1e9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:11.782418 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-21147cb5-ebbb-4ab6-b803-ea27936ab1e9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1315 microversion: 2.1 time: 0.270530 Aug 19 21:09:11.783380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 52/115] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:11 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:11.788367 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-669d91fb-e576-471f-8c67-68a587d612f5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1321 microversion: 2.1 time: 0.363313 Aug 19 21:09:11.788967 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 64/116] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:11 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1321 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:11.799190 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-b198ad97-150b-4133-a8cf-2d231f12f297 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:11.800085 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-b198ad97-150b-4133-a8cf-2d231f12f297 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:11.808442 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b198ad97-150b-4133-a8cf-2d231f12f297 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:11.809216 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b198ad97-150b-4133-a8cf-2d231f12f297 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:11.809910 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b198ad97-150b-4133-a8cf-2d231f12f297 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:11.810790 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b198ad97-150b-4133-a8cf-2d231f12f297 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:11.811395 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b198ad97-150b-4133-a8cf-2d231f12f297 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:11.811969 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b198ad97-150b-4133-a8cf-2d231f12f297 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:11.993248 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b198ad97-150b-4133-a8cf-2d231f12f297 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:12.007189 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-b198ad97-150b-4133-a8cf-2d231f12f297 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1363 microversion: 2.1 time: 0.212716 Aug 19 21:09:12.008522 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 53/117] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:11 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:12.067815 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-98f6c2ac-b5a4-4008-9c76-a51cc1add506 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:12.068953 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-98f6c2ac-b5a4-4008-9c76-a51cc1add506 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:12.076710 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-98f6c2ac-b5a4-4008-9c76-a51cc1add506 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:12.077239 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-98f6c2ac-b5a4-4008-9c76-a51cc1add506 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:12.077700 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-98f6c2ac-b5a4-4008-9c76-a51cc1add506 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:12.078487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-98f6c2ac-b5a4-4008-9c76-a51cc1add506 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:12.078943 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-98f6c2ac-b5a4-4008-9c76-a51cc1add506 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:12.079375 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-98f6c2ac-b5a4-4008-9c76-a51cc1add506 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:12.130103 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-c74d4b2f-31e4-4fc9-99ba-6a383fc395d2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:12.131090 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-c74d4b2f-31e4-4fc9-99ba-6a383fc395d2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:12.142295 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c74d4b2f-31e4-4fc9-99ba-6a383fc395d2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:12.143019 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c74d4b2f-31e4-4fc9-99ba-6a383fc395d2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:12.143585 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c74d4b2f-31e4-4fc9-99ba-6a383fc395d2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:12.144553 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c74d4b2f-31e4-4fc9-99ba-6a383fc395d2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:12.145236 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c74d4b2f-31e4-4fc9-99ba-6a383fc395d2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:12.145945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c74d4b2f-31e4-4fc9-99ba-6a383fc395d2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:12.375255 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-98f6c2ac-b5a4-4008-9c76-a51cc1add506 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:12.384913 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-98f6c2ac-b5a4-4008-9c76-a51cc1add506 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1368 microversion: 2.1 time: 0.321892 Aug 19 21:09:12.385515 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 65/118] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:12 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1368 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:12.406819 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-c74d4b2f-31e4-4fc9-99ba-6a383fc395d2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:12.417605 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-c74d4b2f-31e4-4fc9-99ba-6a383fc395d2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:12.419313 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-c74d4b2f-31e4-4fc9-99ba-6a383fc395d2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:12.420474 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-c74d4b2f-31e4-4fc9-99ba-6a383fc395d2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1406 microversion: 2.20 time: 0.295241 Aug 19 21:09:12.421044 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 54/119] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:12 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:09:12.810276 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-4b29ed1d-5829-4937-90e5-5feb69b41f6d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:12.811409 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-4b29ed1d-5829-4937-90e5-5feb69b41f6d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:12.821029 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4b29ed1d-5829-4937-90e5-5feb69b41f6d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:12.821844 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4b29ed1d-5829-4937-90e5-5feb69b41f6d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:12.822540 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4b29ed1d-5829-4937-90e5-5feb69b41f6d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:12.823391 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4b29ed1d-5829-4937-90e5-5feb69b41f6d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:12.823990 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4b29ed1d-5829-4937-90e5-5feb69b41f6d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:12.824629 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4b29ed1d-5829-4937-90e5-5feb69b41f6d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:12.827982 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-2ca58fa8-6b7f-4cf3-978d-a8c2c8b704d0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:12.829394 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-2ca58fa8-6b7f-4cf3-978d-a8c2c8b704d0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:12.843792 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2ca58fa8-6b7f-4cf3-978d-a8c2c8b704d0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:12.844910 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2ca58fa8-6b7f-4cf3-978d-a8c2c8b704d0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:12.846820 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2ca58fa8-6b7f-4cf3-978d-a8c2c8b704d0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:12.848161 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2ca58fa8-6b7f-4cf3-978d-a8c2c8b704d0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:12.848990 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2ca58fa8-6b7f-4cf3-978d-a8c2c8b704d0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:12.851263 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2ca58fa8-6b7f-4cf3-978d-a8c2c8b704d0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:13.116536 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-4b29ed1d-5829-4937-90e5-5feb69b41f6d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:13.128587 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-4b29ed1d-5829-4937-90e5-5feb69b41f6d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1315 microversion: 2.1 time: 0.325971 Aug 19 21:09:13.138515 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 66/120] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:12 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:13.150057 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-2ca58fa8-6b7f-4cf3-978d-a8c2c8b704d0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:13.156575 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-b3b2af90-e932-4259-9d1a-14e3832cc407 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:13.157193 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-b3b2af90-e932-4259-9d1a-14e3832cc407 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:13.166200 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-2ca58fa8-6b7f-4cf3-978d-a8c2c8b704d0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1321 microversion: 2.1 time: 0.347771 Aug 19 21:09:13.167122 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 55/121] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:12 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1321 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:13.170700 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b3b2af90-e932-4259-9d1a-14e3832cc407 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:13.171711 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b3b2af90-e932-4259-9d1a-14e3832cc407 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:13.172640 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b3b2af90-e932-4259-9d1a-14e3832cc407 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:13.173964 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b3b2af90-e932-4259-9d1a-14e3832cc407 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:13.174893 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b3b2af90-e932-4259-9d1a-14e3832cc407 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:13.175846 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b3b2af90-e932-4259-9d1a-14e3832cc407 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:13.344363 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-b3b2af90-e932-4259-9d1a-14e3832cc407 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:13.362347 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-b3b2af90-e932-4259-9d1a-14e3832cc407 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1363 microversion: 2.1 time: 0.222344 Aug 19 21:09:13.363103 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 67/122] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:13 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:13.413887 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-ace554f9-71f8-4c80-91bf-69835f4e9cff tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:13.415561 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-ace554f9-71f8-4c80-91bf-69835f4e9cff tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:13.429669 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ace554f9-71f8-4c80-91bf-69835f4e9cff tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:13.430570 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ace554f9-71f8-4c80-91bf-69835f4e9cff tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:13.431498 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ace554f9-71f8-4c80-91bf-69835f4e9cff tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:13.432652 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ace554f9-71f8-4c80-91bf-69835f4e9cff tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:13.433484 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ace554f9-71f8-4c80-91bf-69835f4e9cff tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:13.434299 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ace554f9-71f8-4c80-91bf-69835f4e9cff tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:13.447253 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-23407c09-2514-4c19-bdc7-dc470368d98d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:13.448404 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-23407c09-2514-4c19-bdc7-dc470368d98d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:13.458219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-23407c09-2514-4c19-bdc7-dc470368d98d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:13.458845 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-23407c09-2514-4c19-bdc7-dc470368d98d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:13.459905 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-23407c09-2514-4c19-bdc7-dc470368d98d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:13.460911 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-23407c09-2514-4c19-bdc7-dc470368d98d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:13.461535 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-23407c09-2514-4c19-bdc7-dc470368d98d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:13.462119 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-23407c09-2514-4c19-bdc7-dc470368d98d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:13.771981 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-ace554f9-71f8-4c80-91bf-69835f4e9cff tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:13.782322 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-ace554f9-71f8-4c80-91bf-69835f4e9cff tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1368 microversion: 2.1 time: 0.379276 Aug 19 21:09:13.786538 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-23407c09-2514-4c19-bdc7-dc470368d98d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:13.794269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 56/123] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:13 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1368 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:13.802372 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-23407c09-2514-4c19-bdc7-dc470368d98d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:13.806455 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-23407c09-2514-4c19-bdc7-dc470368d98d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:13.808878 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-23407c09-2514-4c19-bdc7-dc470368d98d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1406 microversion: 2.20 time: 0.368423 Aug 19 21:09:13.814903 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 68/124] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:13 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1406 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:09:14.154261 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-57332154-35a5-46ad-920e-a6f2f13907ce tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:14.154934 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-57332154-35a5-46ad-920e-a6f2f13907ce tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:14.163418 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-57332154-35a5-46ad-920e-a6f2f13907ce tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:14.163817 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-57332154-35a5-46ad-920e-a6f2f13907ce tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:14.164425 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-57332154-35a5-46ad-920e-a6f2f13907ce tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:14.165116 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-57332154-35a5-46ad-920e-a6f2f13907ce tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:14.165691 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-57332154-35a5-46ad-920e-a6f2f13907ce tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:14.166276 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-57332154-35a5-46ad-920e-a6f2f13907ce tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:14.201234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c7733e73-d404-43b0-a66a-c7a4594f21cc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:14.203454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-c7733e73-d404-43b0-a66a-c7a4594f21cc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:14.216594 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c7733e73-d404-43b0-a66a-c7a4594f21cc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:14.217857 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c7733e73-d404-43b0-a66a-c7a4594f21cc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:14.219069 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c7733e73-d404-43b0-a66a-c7a4594f21cc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:14.220719 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c7733e73-d404-43b0-a66a-c7a4594f21cc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:14.221688 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c7733e73-d404-43b0-a66a-c7a4594f21cc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:14.222614 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c7733e73-d404-43b0-a66a-c7a4594f21cc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:14.360985 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-57332154-35a5-46ad-920e-a6f2f13907ce tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:14.371668 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-57332154-35a5-46ad-920e-a6f2f13907ce tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1315 microversion: 2.1 time: 0.222102 Aug 19 21:09:14.372435 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 57/125] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:14 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:14.389364 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-b4395024-e20a-4d9d-9552-d7cf357e9021 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:14.390394 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-b4395024-e20a-4d9d-9552-d7cf357e9021 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:14.408855 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b4395024-e20a-4d9d-9552-d7cf357e9021 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:14.409910 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b4395024-e20a-4d9d-9552-d7cf357e9021 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:14.410693 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b4395024-e20a-4d9d-9552-d7cf357e9021 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:14.413348 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b4395024-e20a-4d9d-9552-d7cf357e9021 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:14.415448 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b4395024-e20a-4d9d-9552-d7cf357e9021 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:14.416320 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b4395024-e20a-4d9d-9552-d7cf357e9021 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:14.450876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c7733e73-d404-43b0-a66a-c7a4594f21cc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:14.460359 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-c7733e73-d404-43b0-a66a-c7a4594f21cc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1321 microversion: 2.1 time: 0.274576 Aug 19 21:09:14.460959 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 69/126] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:14 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:14.571373 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b4395024-e20a-4d9d-9552-d7cf357e9021 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:14.579643 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-b4395024-e20a-4d9d-9552-d7cf357e9021 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1363 microversion: 2.1 time: 0.194922 Aug 19 21:09:14.580259 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 58/127] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:14 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:14.804241 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-606a9c5b-040b-4984-8873-f19a5da5dd21 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:14.804871 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-606a9c5b-040b-4984-8873-f19a5da5dd21 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:14.812502 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-606a9c5b-040b-4984-8873-f19a5da5dd21 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:14.812502 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-606a9c5b-040b-4984-8873-f19a5da5dd21 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:14.812798 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-606a9c5b-040b-4984-8873-f19a5da5dd21 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:14.813617 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-606a9c5b-040b-4984-8873-f19a5da5dd21 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:14.814118 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-606a9c5b-040b-4984-8873-f19a5da5dd21 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:14.814549 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-606a9c5b-040b-4984-8873-f19a5da5dd21 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:14.845445 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-667dc441-5f49-4577-89cf-ac19afd1ec1b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:14.846279 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-667dc441-5f49-4577-89cf-ac19afd1ec1b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:14.854370 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-667dc441-5f49-4577-89cf-ac19afd1ec1b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:14.855269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-667dc441-5f49-4577-89cf-ac19afd1ec1b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:14.855866 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-667dc441-5f49-4577-89cf-ac19afd1ec1b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:14.856762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-667dc441-5f49-4577-89cf-ac19afd1ec1b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:14.857221 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-667dc441-5f49-4577-89cf-ac19afd1ec1b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:14.857642 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-667dc441-5f49-4577-89cf-ac19afd1ec1b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:15.050559 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-606a9c5b-040b-4984-8873-f19a5da5dd21 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:15.066141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-606a9c5b-040b-4984-8873-f19a5da5dd21 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1368 microversion: 2.1 time: 0.265482 Aug 19 21:09:15.067200 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 70/128] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:14 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1368 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:15.082688 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-667dc441-5f49-4577-89cf-ac19afd1ec1b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:15.096596 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-667dc441-5f49-4577-89cf-ac19afd1ec1b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:15.099708 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-667dc441-5f49-4577-89cf-ac19afd1ec1b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:15.101284 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-667dc441-5f49-4577-89cf-ac19afd1ec1b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1406 microversion: 2.20 time: 0.260399 Aug 19 21:09:15.102475 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 59/129] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:14 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:09:15.410756 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ea5fb050-aa46-4287-ae1e-89e3ade5c437 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:15.411479 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ea5fb050-aa46-4287-ae1e-89e3ade5c437 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:15.434927 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea5fb050-aa46-4287-ae1e-89e3ade5c437 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:15.435755 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea5fb050-aa46-4287-ae1e-89e3ade5c437 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:15.436692 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea5fb050-aa46-4287-ae1e-89e3ade5c437 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:15.437639 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea5fb050-aa46-4287-ae1e-89e3ade5c437 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:15.438325 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea5fb050-aa46-4287-ae1e-89e3ade5c437 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:15.439290 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea5fb050-aa46-4287-ae1e-89e3ade5c437 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:15.482143 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-6a63d16e-e889-44d0-9d1b-eeb1416ac652 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:15.483240 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-6a63d16e-e889-44d0-9d1b-eeb1416ac652 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:15.491534 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6a63d16e-e889-44d0-9d1b-eeb1416ac652 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:15.492392 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6a63d16e-e889-44d0-9d1b-eeb1416ac652 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:15.493229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6a63d16e-e889-44d0-9d1b-eeb1416ac652 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:15.494351 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6a63d16e-e889-44d0-9d1b-eeb1416ac652 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:15.495076 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6a63d16e-e889-44d0-9d1b-eeb1416ac652 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:15.495820 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6a63d16e-e889-44d0-9d1b-eeb1416ac652 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:15.759584 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ea5fb050-aa46-4287-ae1e-89e3ade5c437 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:15.769335 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ea5fb050-aa46-4287-ae1e-89e3ade5c437 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1315 microversion: 2.1 time: 0.362436 Aug 19 21:09:15.770622 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 71/130] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:15 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:15.777510 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-95b13915-b205-4d29-92b3-071f90b23d5a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:15.778798 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-95b13915-b205-4d29-92b3-071f90b23d5a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:15.788061 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-95b13915-b205-4d29-92b3-071f90b23d5a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:15.789039 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-95b13915-b205-4d29-92b3-071f90b23d5a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:15.789864 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-95b13915-b205-4d29-92b3-071f90b23d5a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:15.791005 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-95b13915-b205-4d29-92b3-071f90b23d5a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:15.791661 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-95b13915-b205-4d29-92b3-071f90b23d5a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:15.792301 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-95b13915-b205-4d29-92b3-071f90b23d5a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:15.835873 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-6a63d16e-e889-44d0-9d1b-eeb1416ac652 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:15.839800 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=100 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:15.855699 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-6a63d16e-e889-44d0-9d1b-eeb1416ac652 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1321 microversion: 2.1 time: 0.377195 Aug 19 21:09:15.857223 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 60/131] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:15 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1321 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:16.032421 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-95b13915-b205-4d29-92b3-071f90b23d5a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:16.043859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-95b13915-b205-4d29-92b3-071f90b23d5a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1363 microversion: 2.1 time: 0.271276 Aug 19 21:09:16.044669 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 72/132] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:15 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:16.106543 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-89d59419-c6a8-4d85-889a-52609f8c6505 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:16.107985 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-89d59419-c6a8-4d85-889a-52609f8c6505 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:16.116880 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-89d59419-c6a8-4d85-889a-52609f8c6505 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:16.117519 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-89d59419-c6a8-4d85-889a-52609f8c6505 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:16.118247 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-89d59419-c6a8-4d85-889a-52609f8c6505 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:16.119418 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-89d59419-c6a8-4d85-889a-52609f8c6505 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:16.120064 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-89d59419-c6a8-4d85-889a-52609f8c6505 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:16.120553 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-89d59419-c6a8-4d85-889a-52609f8c6505 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:16.141098 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-735c19e9-489e-42e1-9dd7-398a4a279948 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:16.143127 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-735c19e9-489e-42e1-9dd7-398a4a279948 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:16.154803 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-735c19e9-489e-42e1-9dd7-398a4a279948 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:16.156121 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-735c19e9-489e-42e1-9dd7-398a4a279948 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:16.157548 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-735c19e9-489e-42e1-9dd7-398a4a279948 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:16.159195 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-735c19e9-489e-42e1-9dd7-398a4a279948 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:16.160329 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-735c19e9-489e-42e1-9dd7-398a4a279948 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:16.161398 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-735c19e9-489e-42e1-9dd7-398a4a279948 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:16.400820 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-89d59419-c6a8-4d85-889a-52609f8c6505 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:16.424619 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-89d59419-c6a8-4d85-889a-52609f8c6505 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1368 microversion: 2.1 time: 0.324827 Aug 19 21:09:16.426294 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 61/133] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:16 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1368 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:16.468226 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-735c19e9-489e-42e1-9dd7-398a4a279948 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:16.485449 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-735c19e9-489e-42e1-9dd7-398a4a279948 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:16.487087 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-735c19e9-489e-42e1-9dd7-398a4a279948 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:16.488242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-735c19e9-489e-42e1-9dd7-398a4a279948 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1406 microversion: 2.20 time: 0.354969 Aug 19 21:09:16.489393 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 73/134] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:16 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1406 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:09:16.809703 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-52df8355-1ad1-40c4-a30c-0a5badda5ef8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:16.810428 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-52df8355-1ad1-40c4-a30c-0a5badda5ef8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:16.824906 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-52df8355-1ad1-40c4-a30c-0a5badda5ef8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:16.825659 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-52df8355-1ad1-40c4-a30c-0a5badda5ef8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:16.826160 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-52df8355-1ad1-40c4-a30c-0a5badda5ef8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:16.826942 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-52df8355-1ad1-40c4-a30c-0a5badda5ef8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:16.827416 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-52df8355-1ad1-40c4-a30c-0a5badda5ef8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:16.827846 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-52df8355-1ad1-40c4-a30c-0a5badda5ef8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:16.893410 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-477ca690-d124-4058-b2f6-3b590423656b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:16.896117 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-477ca690-d124-4058-b2f6-3b590423656b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:16.907562 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-477ca690-d124-4058-b2f6-3b590423656b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:16.917150 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-477ca690-d124-4058-b2f6-3b590423656b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:16.917961 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-477ca690-d124-4058-b2f6-3b590423656b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:16.918839 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-477ca690-d124-4058-b2f6-3b590423656b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:16.919433 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-477ca690-d124-4058-b2f6-3b590423656b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:16.922997 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-477ca690-d124-4058-b2f6-3b590423656b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:17.763575 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-52df8355-1ad1-40c4-a30c-0a5badda5ef8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:17.784753 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-52df8355-1ad1-40c4-a30c-0a5badda5ef8 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1315 microversion: 2.1 time: 0.979856 Aug 19 21:09:17.798011 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 62/135] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:16 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1315 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:17.821081 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-9f4e2234-4f18-4daf-866f-48c19917423d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:17.828259 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-9f4e2234-4f18-4daf-866f-48c19917423d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:17.845165 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:17.863695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9f4e2234-4f18-4daf-866f-48c19917423d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:17.865138 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9f4e2234-4f18-4daf-866f-48c19917423d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:17.868691 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9f4e2234-4f18-4daf-866f-48c19917423d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:17.874128 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9f4e2234-4f18-4daf-866f-48c19917423d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:17.876675 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9f4e2234-4f18-4daf-866f-48c19917423d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:17.880140 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9f4e2234-4f18-4daf-866f-48c19917423d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:18.119132 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-477ca690-d124-4058-b2f6-3b590423656b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:18.129676 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-477ca690-d124-4058-b2f6-3b590423656b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1321 microversion: 2.1 time: 1.241043 Aug 19 21:09:18.131621 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 74/136] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:16 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1321 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:18.136898 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-082a4c73-7ccc-4260-8d4a-3a680334d614 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:18.138981 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-082a4c73-7ccc-4260-8d4a-3a680334d614 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:18.148200 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-082a4c73-7ccc-4260-8d4a-3a680334d614 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:18.149151 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-082a4c73-7ccc-4260-8d4a-3a680334d614 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:18.149818 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-082a4c73-7ccc-4260-8d4a-3a680334d614 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:18.151006 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-082a4c73-7ccc-4260-8d4a-3a680334d614 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:18.151715 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-082a4c73-7ccc-4260-8d4a-3a680334d614 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:18.152341 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-082a4c73-7ccc-4260-8d4a-3a680334d614 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:18.566469 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9f4e2234-4f18-4daf-866f-48c19917423d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:18.592615 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-9f4e2234-4f18-4daf-866f-48c19917423d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1363 microversion: 2.1 time: 0.790028 Aug 19 21:09:18.593676 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 63/137] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:17 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1363 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:18.598983 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-082a4c73-7ccc-4260-8d4a-3a680334d614 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:18.612820 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-082a4c73-7ccc-4260-8d4a-3a680334d614 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1368 microversion: 2.1 time: 0.479813 Aug 19 21:09:18.615732 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 75/138] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:18 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1368 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:18.628280 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-746155e2-9067-4192-9720-2cb8f17983b6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:18.628629 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-76ded1b1-9b8a-4ae7-8225-2731098cd591 req-4e605028-0d92-4442-9e27-6ecc26f31a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4198f280-df5c-423d-9641-15abbd378905", "name": "network-vif-plugged", "status": "completed", "tag": "f53aeb6e-aa9c-48b2-9f9c-ea05217129dc"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:09:18.632954 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-746155e2-9067-4192-9720-2cb8f17983b6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:18.658044 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-746155e2-9067-4192-9720-2cb8f17983b6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:18.660693 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-76ded1b1-9b8a-4ae7-8225-2731098cd591 req-4e605028-0d92-4442-9e27-6ecc26f31a00 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:18.661653 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-746155e2-9067-4192-9720-2cb8f17983b6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:18.663928 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-76ded1b1-9b8a-4ae7-8225-2731098cd591 req-4e605028-0d92-4442-9e27-6ecc26f31a00 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:18.664483 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-76ded1b1-9b8a-4ae7-8225-2731098cd591 req-4e605028-0d92-4442-9e27-6ecc26f31a00 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:18.665614 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-746155e2-9067-4192-9720-2cb8f17983b6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:18.667468 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-746155e2-9067-4192-9720-2cb8f17983b6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:18.669149 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-746155e2-9067-4192-9720-2cb8f17983b6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:18.672357 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-746155e2-9067-4192-9720-2cb8f17983b6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:18.715023 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-76ded1b1-9b8a-4ae7-8225-2731098cd591 req-4e605028-0d92-4442-9e27-6ecc26f31a00 service nova] Creating event network-vif-plugged:f53aeb6e-aa9c-48b2-9f9c-ea05217129dc for instance 4198f280-df5c-423d-9641-15abbd378905 on hv-cinder-85220 Aug 19 21:09:18.729637 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-76ded1b1-9b8a-4ae7-8225-2731098cd591 req-4e605028-0d92-4442-9e27-6ecc26f31a00 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110632 Aug 19 21:09:18.733412 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 76/139] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:09:18.773849 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-e3df9d93-19c7-4837-8f43-f3fd2e2d9dfa req-c2a5c944-f12c-415b-bb37-070a213b97ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e25852-2606-4138-b039-56a9ed0b7f1e", "tag": "e5fb615f-643a-4ed9-ae40-bd62d59a8fc5"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:09:18.818528 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-e3df9d93-19c7-4837-8f43-f3fd2e2d9dfa req-c2a5c944-f12c-415b-bb37-070a213b97ee service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:18.820919 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-e3df9d93-19c7-4837-8f43-f3fd2e2d9dfa req-c2a5c944-f12c-415b-bb37-070a213b97ee service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:18.825143 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-e3df9d93-19c7-4837-8f43-f3fd2e2d9dfa req-c2a5c944-f12c-415b-bb37-070a213b97ee service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:18.864998 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-e3df9d93-19c7-4837-8f43-f3fd2e2d9dfa req-c2a5c944-f12c-415b-bb37-070a213b97ee service nova] Creating event network-changed:e5fb615f-643a-4ed9-ae40-bd62d59a8fc5 for instance d7e25852-2606-4138-b039-56a9ed0b7f1e on hv-cinder-85220 Aug 19 21:09:18.876735 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-e3df9d93-19c7-4837-8f43-f3fd2e2d9dfa req-c2a5c944-f12c-415b-bb37-070a213b97ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138389 Aug 19 21:09:18.879795 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 77/140] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:09:18.912979 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-2ca47eb9-e4eb-40ce-925d-cc55f9003cf4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:18.912979 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-2ca47eb9-e4eb-40ce-925d-cc55f9003cf4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:18.929165 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2ca47eb9-e4eb-40ce-925d-cc55f9003cf4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:18.930374 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2ca47eb9-e4eb-40ce-925d-cc55f9003cf4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:18.931125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2ca47eb9-e4eb-40ce-925d-cc55f9003cf4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:18.935242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2ca47eb9-e4eb-40ce-925d-cc55f9003cf4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:18.938294 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2ca47eb9-e4eb-40ce-925d-cc55f9003cf4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:18.939022 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2ca47eb9-e4eb-40ce-925d-cc55f9003cf4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:19.421228 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-746155e2-9067-4192-9720-2cb8f17983b6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:19.427068 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-2ca47eb9-e4eb-40ce-925d-cc55f9003cf4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:19.441078 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=100 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:19.446755 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-2ca47eb9-e4eb-40ce-925d-cc55f9003cf4 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1315 microversion: 2.1 time: 0.563619 Aug 19 21:09:19.447572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 78/141] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:18 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1315 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:19.449171 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-746155e2-9067-4192-9720-2cb8f17983b6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:19.451938 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-746155e2-9067-4192-9720-2cb8f17983b6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:19.453521 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-746155e2-9067-4192-9720-2cb8f17983b6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1406 microversion: 2.20 time: 0.858168 Aug 19 21:09:19.454389 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 64/142] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:18 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1406 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:09:19.455742 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-b67dcd88-c198-4176-af01-6cdfa7857189 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:19.456623 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-b67dcd88-c198-4176-af01-6cdfa7857189 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:19.464367 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b67dcd88-c198-4176-af01-6cdfa7857189 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:19.465273 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b67dcd88-c198-4176-af01-6cdfa7857189 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:19.465917 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b67dcd88-c198-4176-af01-6cdfa7857189 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:19.467504 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b67dcd88-c198-4176-af01-6cdfa7857189 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:19.468239 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b67dcd88-c198-4176-af01-6cdfa7857189 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:19.469039 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b67dcd88-c198-4176-af01-6cdfa7857189 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:19.631178 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-f5710815-0bf0-47dc-a58f-b303384c18ee tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:19.632615 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-f5710815-0bf0-47dc-a58f-b303384c18ee tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:19.644817 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f5710815-0bf0-47dc-a58f-b303384c18ee tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:19.645641 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f5710815-0bf0-47dc-a58f-b303384c18ee tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:19.646932 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f5710815-0bf0-47dc-a58f-b303384c18ee tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:19.648891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f5710815-0bf0-47dc-a58f-b303384c18ee tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:19.649657 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f5710815-0bf0-47dc-a58f-b303384c18ee tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:19.650219 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f5710815-0bf0-47dc-a58f-b303384c18ee tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:19.917489 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-b67dcd88-c198-4176-af01-6cdfa7857189 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:19.933430 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-b67dcd88-c198-4176-af01-6cdfa7857189 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1321 microversion: 2.1 time: 0.484519 Aug 19 21:09:19.934729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 79/143] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:19 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1321 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:19.940544 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3fe74321-3600-4357-92cb-27f832cd7cf0 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:19.941378 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-3fe74321-3600-4357-92cb-27f832cd7cf0 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:19.953623 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3fe74321-3600-4357-92cb-27f832cd7cf0 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:19.954166 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3fe74321-3600-4357-92cb-27f832cd7cf0 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:19.954737 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3fe74321-3600-4357-92cb-27f832cd7cf0 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:19.955909 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3fe74321-3600-4357-92cb-27f832cd7cf0 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:19.956391 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3fe74321-3600-4357-92cb-27f832cd7cf0 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:19.957373 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3fe74321-3600-4357-92cb-27f832cd7cf0 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:20.016160 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-f5710815-0bf0-47dc-a58f-b303384c18ee tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:20.049147 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-f5710815-0bf0-47dc-a58f-b303384c18ee tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1363 microversion: 2.1 time: 0.424186 Aug 19 21:09:20.062538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 65/144] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:19 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1363 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:20.081583 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-ef7314dc-d94b-4a13-bfad-9ee85ab8c5c8 req-f12d74ec-3567-4488-b421-9608b82b2650 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99339e5a-af6a-4d00-a02b-cec028b663ae", "tag": "31356ae8-39a1-429f-bfe4-d7a38947ed9f"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:09:20.095320 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-ef7314dc-d94b-4a13-bfad-9ee85ab8c5c8 req-f12d74ec-3567-4488-b421-9608b82b2650 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:20.095811 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-ef7314dc-d94b-4a13-bfad-9ee85ab8c5c8 req-f12d74ec-3567-4488-b421-9608b82b2650 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:20.096249 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-ef7314dc-d94b-4a13-bfad-9ee85ab8c5c8 req-f12d74ec-3567-4488-b421-9608b82b2650 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:20.109243 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-ef7314dc-d94b-4a13-bfad-9ee85ab8c5c8 req-f12d74ec-3567-4488-b421-9608b82b2650 service nova] Creating event network-changed:31356ae8-39a1-429f-bfe4-d7a38947ed9f for instance 99339e5a-af6a-4d00-a02b-cec028b663ae on hv-cinder-85220 Aug 19 21:09:20.114931 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-ef7314dc-d94b-4a13-bfad-9ee85ab8c5c8 req-f12d74ec-3567-4488-b421-9608b82b2650 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050221 Aug 19 21:09:20.115613 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 66/145] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:09:20.186094 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3fe74321-3600-4357-92cb-27f832cd7cf0 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:20.201741 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-3fe74321-3600-4357-92cb-27f832cd7cf0 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1368 microversion: 2.1 time: 0.264763 Aug 19 21:09:20.213841 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 80/146] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:19 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1368 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:20.474159 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-0c936480-87b0-4220-b48c-55f95b4d26de tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:20.487361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-86484e16-913b-42b7-babe-0bc62816e2e8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:20.490492 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-86484e16-913b-42b7-babe-0bc62816e2e8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:20.499074 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-0c936480-87b0-4220-b48c-55f95b4d26de tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:20.531397 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-86484e16-913b-42b7-babe-0bc62816e2e8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:20.531903 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-86484e16-913b-42b7-babe-0bc62816e2e8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:20.535986 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0c936480-87b0-4220-b48c-55f95b4d26de tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:20.536467 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0c936480-87b0-4220-b48c-55f95b4d26de tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:20.540350 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0c936480-87b0-4220-b48c-55f95b4d26de tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:20.543567 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-86484e16-913b-42b7-babe-0bc62816e2e8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:20.544728 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0c936480-87b0-4220-b48c-55f95b4d26de tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:20.545426 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0c936480-87b0-4220-b48c-55f95b4d26de tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:20.545539 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-86484e16-913b-42b7-babe-0bc62816e2e8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:20.546159 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-86484e16-913b-42b7-babe-0bc62816e2e8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:20.546366 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0c936480-87b0-4220-b48c-55f95b4d26de tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:20.548726 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-86484e16-913b-42b7-babe-0bc62816e2e8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:21.078840 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-0c936480-87b0-4220-b48c-55f95b4d26de tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:21.088968 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-86484e16-913b-42b7-babe-0bc62816e2e8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:21.098139 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-0c936480-87b0-4220-b48c-55f95b4d26de tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1315 microversion: 2.1 time: 0.632747 Aug 19 21:09:21.098739 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 67/147] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:20 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1315 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:21.101809 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-86484e16-913b-42b7-babe-0bc62816e2e8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:21.104109 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-86484e16-913b-42b7-babe-0bc62816e2e8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:21.105289 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-86484e16-913b-42b7-babe-0bc62816e2e8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1406 microversion: 2.20 time: 0.626141 Aug 19 21:09:21.105864 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 81/148] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:20 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1406 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:09:21.111421 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-58744aab-2816-46f7-9011-bd674f172cba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:21.112714 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-58744aab-2816-46f7-9011-bd674f172cba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:21.123259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58744aab-2816-46f7-9011-bd674f172cba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:21.123824 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-e550482b-da7b-488a-b8e3-f261ce309526 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:21.123970 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58744aab-2816-46f7-9011-bd674f172cba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:21.124264 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58744aab-2816-46f7-9011-bd674f172cba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:21.124458 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-e550482b-da7b-488a-b8e3-f261ce309526 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:21.124986 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58744aab-2816-46f7-9011-bd674f172cba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:21.126297 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58744aab-2816-46f7-9011-bd674f172cba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:21.127033 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58744aab-2816-46f7-9011-bd674f172cba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:21.133511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e550482b-da7b-488a-b8e3-f261ce309526 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:21.134065 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e550482b-da7b-488a-b8e3-f261ce309526 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:21.134547 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e550482b-da7b-488a-b8e3-f261ce309526 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:21.135492 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e550482b-da7b-488a-b8e3-f261ce309526 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:21.136177 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e550482b-da7b-488a-b8e3-f261ce309526 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:21.136801 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e550482b-da7b-488a-b8e3-f261ce309526 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:21.378338 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-58744aab-2816-46f7-9011-bd674f172cba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:21.383176 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-e550482b-da7b-488a-b8e3-f261ce309526 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:21.400539 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-e550482b-da7b-488a-b8e3-f261ce309526 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1515 microversion: 2.1 time: 0.288359 Aug 19 21:09:21.406715 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-58744aab-2816-46f7-9011-bd674f172cba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1363 microversion: 2.1 time: 0.299792 Aug 19 21:09:21.409549 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 82/149] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:21 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1363 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:21.415976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8e9213d0-e985-4a00-958e-67b3fe39158e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:21.416727 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8e9213d0-e985-4a00-958e-67b3fe39158e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:21.418673 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 68/150] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:21 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1515 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:21.437039 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8e9213d0-e985-4a00-958e-67b3fe39158e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:21.437946 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8e9213d0-e985-4a00-958e-67b3fe39158e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:21.439330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8e9213d0-e985-4a00-958e-67b3fe39158e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:21.441412 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8e9213d0-e985-4a00-958e-67b3fe39158e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:21.442259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8e9213d0-e985-4a00-958e-67b3fe39158e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:21.446100 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8e9213d0-e985-4a00-958e-67b3fe39158e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:21.452703 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-676431da-f865-4f0b-974f-ed87104bb668 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:09:21.457261 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-676431da-f865-4f0b-974f-ed87104bb668 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:21.468717 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-676431da-f865-4f0b-974f-ed87104bb668 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:21.469491 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-676431da-f865-4f0b-974f-ed87104bb668 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:21.470638 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-676431da-f865-4f0b-974f-ed87104bb668 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:21.472007 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-676431da-f865-4f0b-974f-ed87104bb668 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:21.472810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-676431da-f865-4f0b-974f-ed87104bb668 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:21.473589 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-676431da-f865-4f0b-974f-ed87104bb668 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:21.564234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.objects.instance [None req-676431da-f865-4f0b-974f-ed87104bb668 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lazy-loading 'flavor' on Instance uuid eeac61e2-44ff-4477-94da-a109f4907096 {{(pid=120876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:09:21.768083 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8e9213d0-e985-4a00-958e-67b3fe39158e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:21.778852 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8e9213d0-e985-4a00-958e-67b3fe39158e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1368 microversion: 2.1 time: 0.370450 Aug 19 21:09:21.779849 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 83/151] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:21 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1368 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:21.809376 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-676431da-f865-4f0b-974f-ed87104bb668 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "POST /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096/action" status: 200 len: 32 microversion: 2.1 time: 0.363363 Aug 19 21:09:21.810519 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 69/152] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Aug 19 21:09:21 2022] POST /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096/action => generated 32 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 21:09:21.825702 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-b6248b68-2ede-4868-b524-b6606114847d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:21.828619 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-b6248b68-2ede-4868-b524-b6606114847d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:21.843435 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b6248b68-2ede-4868-b524-b6606114847d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:21.844734 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b6248b68-2ede-4868-b524-b6606114847d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:21.845973 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b6248b68-2ede-4868-b524-b6606114847d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:21.847624 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b6248b68-2ede-4868-b524-b6606114847d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:21.849797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b6248b68-2ede-4868-b524-b6606114847d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:21.853872 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b6248b68-2ede-4868-b524-b6606114847d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:22.117686 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-b6248b68-2ede-4868-b524-b6606114847d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:22.138327 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-916b8d71-a1a6-4c32-85c0-c736b53e5b4d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:22.138632 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-b6248b68-2ede-4868-b524-b6606114847d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.321007 Aug 19 21:09:22.140692 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-916b8d71-a1a6-4c32-85c0-c736b53e5b4d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:22.143335 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 84/153] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:21 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:22.161347 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-916b8d71-a1a6-4c32-85c0-c736b53e5b4d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:22.163998 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-916b8d71-a1a6-4c32-85c0-c736b53e5b4d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:22.165338 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-916b8d71-a1a6-4c32-85c0-c736b53e5b4d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:22.165513 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-30dd4da1-f631-4162-8414-8f89bc1a320a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:22.167497 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-916b8d71-a1a6-4c32-85c0-c736b53e5b4d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:22.168498 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-916b8d71-a1a6-4c32-85c0-c736b53e5b4d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:22.169300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-916b8d71-a1a6-4c32-85c0-c736b53e5b4d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:22.170896 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-30dd4da1-f631-4162-8414-8f89bc1a320a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:22.193033 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-30dd4da1-f631-4162-8414-8f89bc1a320a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:22.194723 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-30dd4da1-f631-4162-8414-8f89bc1a320a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:22.195749 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-30dd4da1-f631-4162-8414-8f89bc1a320a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:22.197974 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-30dd4da1-f631-4162-8414-8f89bc1a320a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:22.199082 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-30dd4da1-f631-4162-8414-8f89bc1a320a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:22.200267 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-30dd4da1-f631-4162-8414-8f89bc1a320a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:22.599101 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-30dd4da1-f631-4162-8414-8f89bc1a320a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:22.616175 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-916b8d71-a1a6-4c32-85c0-c736b53e5b4d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:22.629152 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-916b8d71-a1a6-4c32-85c0-c736b53e5b4d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1315 microversion: 2.1 time: 0.507505 Aug 19 21:09:22.630077 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-30dd4da1-f631-4162-8414-8f89bc1a320a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:22.631782 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 70/154] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:22 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:22.634193 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-30dd4da1-f631-4162-8414-8f89bc1a320a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:22.635533 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-30dd4da1-f631-4162-8414-8f89bc1a320a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1406 microversion: 2.20 time: 0.482389 Aug 19 21:09:22.636245 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 85/155] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:22 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1406 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:09:22.649957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-ea9dea6d-44fd-4f28-8e30-1c3c201ae399 req-94b8af79-fd04-42b9-9bc9-fe55011aefac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f95c060a-e4cc-436c-a185-9345fd2c44f2", "tag": "c65527c3-278b-404c-9369-abd76c37a0b5"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:09:22.670400 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-ea9dea6d-44fd-4f28-8e30-1c3c201ae399 req-94b8af79-fd04-42b9-9bc9-fe55011aefac service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:22.671487 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-ea9dea6d-44fd-4f28-8e30-1c3c201ae399 req-94b8af79-fd04-42b9-9bc9-fe55011aefac service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:22.672370 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-ea9dea6d-44fd-4f28-8e30-1c3c201ae399 req-94b8af79-fd04-42b9-9bc9-fe55011aefac service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:22.673805 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-206901b6-1131-4280-bd32-13d4944493fe tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:22.674876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-206901b6-1131-4280-bd32-13d4944493fe tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:22.687335 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-206901b6-1131-4280-bd32-13d4944493fe tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:22.688139 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-206901b6-1131-4280-bd32-13d4944493fe tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:22.689251 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-206901b6-1131-4280-bd32-13d4944493fe tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:22.690829 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-206901b6-1131-4280-bd32-13d4944493fe tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:22.691932 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-206901b6-1131-4280-bd32-13d4944493fe tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:22.693715 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-206901b6-1131-4280-bd32-13d4944493fe tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:22.698099 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-ea9dea6d-44fd-4f28-8e30-1c3c201ae399 req-94b8af79-fd04-42b9-9bc9-fe55011aefac service nova] Creating event network-changed:c65527c3-278b-404c-9369-abd76c37a0b5 for instance f95c060a-e4cc-436c-a185-9345fd2c44f2 on hv-cinder-85220 Aug 19 21:09:22.711616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-ea9dea6d-44fd-4f28-8e30-1c3c201ae399 req-94b8af79-fd04-42b9-9bc9-fe55011aefac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077457 Aug 19 21:09:22.713568 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 71/156] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:09:22.805655 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-bba1194a-969b-497c-a8dd-112eaf58e06b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:22.806571 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-bba1194a-969b-497c-a8dd-112eaf58e06b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:22.814919 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-bba1194a-969b-497c-a8dd-112eaf58e06b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:22.815654 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-bba1194a-969b-497c-a8dd-112eaf58e06b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:22.816346 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-bba1194a-969b-497c-a8dd-112eaf58e06b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:22.819021 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-bba1194a-969b-497c-a8dd-112eaf58e06b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:22.819770 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-bba1194a-969b-497c-a8dd-112eaf58e06b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:22.820458 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-bba1194a-969b-497c-a8dd-112eaf58e06b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:22.933750 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-206901b6-1131-4280-bd32-13d4944493fe tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:22.946913 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-206901b6-1131-4280-bd32-13d4944493fe tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1363 microversion: 2.1 time: 0.294960 Aug 19 21:09:22.948449 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 86/157] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:22 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1363 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:23.045582 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-bba1194a-969b-497c-a8dd-112eaf58e06b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:23.086537 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-bba1194a-969b-497c-a8dd-112eaf58e06b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1368 microversion: 2.1 time: 0.286302 Aug 19 21:09:23.097806 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 72/158] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:22 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1368 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:23.178400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-1e5c800c-52d4-4320-9950-f62fc7331c39 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:23.179519 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-1e5c800c-52d4-4320-9950-f62fc7331c39 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:23.191171 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1e5c800c-52d4-4320-9950-f62fc7331c39 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:23.191986 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1e5c800c-52d4-4320-9950-f62fc7331c39 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:23.194131 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1e5c800c-52d4-4320-9950-f62fc7331c39 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:23.195839 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1e5c800c-52d4-4320-9950-f62fc7331c39 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:23.197261 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1e5c800c-52d4-4320-9950-f62fc7331c39 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:23.198517 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1e5c800c-52d4-4320-9950-f62fc7331c39 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:23.410200 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-1e5c800c-52d4-4320-9950-f62fc7331c39 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:23.419606 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-1e5c800c-52d4-4320-9950-f62fc7331c39 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.248375 Aug 19 21:09:23.420335 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 87/159] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:23 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:23.656422 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-987be1f0-7e9a-40d5-ac0d-aedbbfbc7030 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:23.657995 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-987be1f0-7e9a-40d5-ac0d-aedbbfbc7030 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:23.678972 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e86b656a-3cba-43d6-9771-8bf44d159868 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:23.679880 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-e86b656a-3cba-43d6-9771-8bf44d159868 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:23.693634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-987be1f0-7e9a-40d5-ac0d-aedbbfbc7030 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:23.694259 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-987be1f0-7e9a-40d5-ac0d-aedbbfbc7030 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:23.694700 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-987be1f0-7e9a-40d5-ac0d-aedbbfbc7030 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:23.695431 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-987be1f0-7e9a-40d5-ac0d-aedbbfbc7030 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:23.695892 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-987be1f0-7e9a-40d5-ac0d-aedbbfbc7030 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:23.699482 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e86b656a-3cba-43d6-9771-8bf44d159868 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:23.703949 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e86b656a-3cba-43d6-9771-8bf44d159868 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:23.705030 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e86b656a-3cba-43d6-9771-8bf44d159868 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:23.706355 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-987be1f0-7e9a-40d5-ac0d-aedbbfbc7030 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:23.707484 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e86b656a-3cba-43d6-9771-8bf44d159868 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:23.710888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e86b656a-3cba-43d6-9771-8bf44d159868 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:23.718878 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e86b656a-3cba-43d6-9771-8bf44d159868 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:24.629059 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e86b656a-3cba-43d6-9771-8bf44d159868 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:24.663117 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e86b656a-3cba-43d6-9771-8bf44d159868 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:24.673136 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e86b656a-3cba-43d6-9771-8bf44d159868 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:24.675402 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e86b656a-3cba-43d6-9771-8bf44d159868 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1406 microversion: 2.20 time: 1.001537 Aug 19 21:09:24.682930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 88/160] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:23 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1406 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:09:24.716627 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-18c36360-00cf-4241-ba2f-6982b65d5cc8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:24.717457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-18c36360-00cf-4241-ba2f-6982b65d5cc8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:24.729216 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-987be1f0-7e9a-40d5-ac0d-aedbbfbc7030 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:24.738951 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-987be1f0-7e9a-40d5-ac0d-aedbbfbc7030 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1315 microversion: 2.1 time: 1.089551 Aug 19 21:09:24.744573 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 73/161] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:23 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1315 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:24.749428 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-f4da2ef7-a142-4fc6-a82c-5dfcb14e5615 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:24.750091 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-f4da2ef7-a142-4fc6-a82c-5dfcb14e5615 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:24.765005 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-18c36360-00cf-4241-ba2f-6982b65d5cc8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:24.769664 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-18c36360-00cf-4241-ba2f-6982b65d5cc8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:24.770388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-18c36360-00cf-4241-ba2f-6982b65d5cc8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:24.771814 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f4da2ef7-a142-4fc6-a82c-5dfcb14e5615 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:24.772589 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f4da2ef7-a142-4fc6-a82c-5dfcb14e5615 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:24.773192 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f4da2ef7-a142-4fc6-a82c-5dfcb14e5615 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:24.775095 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f4da2ef7-a142-4fc6-a82c-5dfcb14e5615 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:24.777309 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-18c36360-00cf-4241-ba2f-6982b65d5cc8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:24.778147 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-18c36360-00cf-4241-ba2f-6982b65d5cc8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:24.778405 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f4da2ef7-a142-4fc6-a82c-5dfcb14e5615 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:24.778648 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-18c36360-00cf-4241-ba2f-6982b65d5cc8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:24.779196 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f4da2ef7-a142-4fc6-a82c-5dfcb14e5615 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:25.313240 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-f4da2ef7-a142-4fc6-a82c-5dfcb14e5615 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:25.326780 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-f4da2ef7-a142-4fc6-a82c-5dfcb14e5615 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1368 microversion: 2.1 time: 0.581025 Aug 19 21:09:25.327614 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 74/162] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:24 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1368 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:25.328884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-18c36360-00cf-4241-ba2f-6982b65d5cc8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:25.334488 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-a706f861-550f-4dd9-896d-661456527f23 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:25.335465 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-a706f861-550f-4dd9-896d-661456527f23 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:25.341859 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a706f861-550f-4dd9-896d-661456527f23 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:25.342462 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a706f861-550f-4dd9-896d-661456527f23 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:25.343060 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a706f861-550f-4dd9-896d-661456527f23 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:25.343878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a706f861-550f-4dd9-896d-661456527f23 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:25.344084 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-18c36360-00cf-4241-ba2f-6982b65d5cc8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1363 microversion: 2.1 time: 0.659335 Aug 19 21:09:25.344541 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a706f861-550f-4dd9-896d-661456527f23 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:25.345111 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a706f861-550f-4dd9-896d-661456527f23 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:25.361000 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 89/163] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:24 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1363 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:25.555306 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-a706f861-550f-4dd9-896d-661456527f23 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:25.569013 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-a706f861-550f-4dd9-896d-661456527f23 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.239480 Aug 19 21:09:25.570139 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 75/164] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:25 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:25.723007 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-86017e28-53ab-4b6b-88bc-bb21f8ef92db tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:25.727008 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-86017e28-53ab-4b6b-88bc-bb21f8ef92db tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:25.744128 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-86017e28-53ab-4b6b-88bc-bb21f8ef92db tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:25.745310 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-86017e28-53ab-4b6b-88bc-bb21f8ef92db tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:25.746120 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-86017e28-53ab-4b6b-88bc-bb21f8ef92db tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:25.747669 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-86017e28-53ab-4b6b-88bc-bb21f8ef92db tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:25.748761 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-86017e28-53ab-4b6b-88bc-bb21f8ef92db tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:25.749812 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-86017e28-53ab-4b6b-88bc-bb21f8ef92db tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:25.770613 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-8efdb088-bdf0-4e77-9c5c-80feb5213aeb tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:25.771497 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-8efdb088-bdf0-4e77-9c5c-80feb5213aeb tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:25.777815 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8efdb088-bdf0-4e77-9c5c-80feb5213aeb tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:25.778520 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8efdb088-bdf0-4e77-9c5c-80feb5213aeb tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:25.779102 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8efdb088-bdf0-4e77-9c5c-80feb5213aeb tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:25.780076 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8efdb088-bdf0-4e77-9c5c-80feb5213aeb tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:25.780524 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8efdb088-bdf0-4e77-9c5c-80feb5213aeb tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:25.781104 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8efdb088-bdf0-4e77-9c5c-80feb5213aeb tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:26.009018 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-86017e28-53ab-4b6b-88bc-bb21f8ef92db tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:26.016207 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-8efdb088-bdf0-4e77-9c5c-80feb5213aeb tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:26.018667 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:26.024209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-86017e28-53ab-4b6b-88bc-bb21f8ef92db tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:26.026116 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-86017e28-53ab-4b6b-88bc-bb21f8ef92db tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:26.027321 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-86017e28-53ab-4b6b-88bc-bb21f8ef92db tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1406 microversion: 2.20 time: 0.312938 Aug 19 21:09:26.027891 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 90/165] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:25 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:09:26.041196 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-8efdb088-bdf0-4e77-9c5c-80feb5213aeb tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1502 microversion: 2.1 time: 0.274262 Aug 19 21:09:26.058785 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 76/166] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:25 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1502 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:26.366212 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-dad31140-f7fc-4f0e-a578-4d319f1493b5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:26.367284 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-dad31140-f7fc-4f0e-a578-4d319f1493b5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:26.376889 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-c8bb0749-7b19-4c6e-b6cb-d924c2b7e477 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:26.377925 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dad31140-f7fc-4f0e-a578-4d319f1493b5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:26.378687 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-c8bb0749-7b19-4c6e-b6cb-d924c2b7e477 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:26.379205 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dad31140-f7fc-4f0e-a578-4d319f1493b5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:26.380139 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dad31140-f7fc-4f0e-a578-4d319f1493b5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:26.382482 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dad31140-f7fc-4f0e-a578-4d319f1493b5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:26.383515 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dad31140-f7fc-4f0e-a578-4d319f1493b5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:26.384268 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dad31140-f7fc-4f0e-a578-4d319f1493b5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:26.416046 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c8bb0749-7b19-4c6e-b6cb-d924c2b7e477 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:26.416895 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c8bb0749-7b19-4c6e-b6cb-d924c2b7e477 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:26.418223 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c8bb0749-7b19-4c6e-b6cb-d924c2b7e477 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:26.419422 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c8bb0749-7b19-4c6e-b6cb-d924c2b7e477 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:26.420431 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c8bb0749-7b19-4c6e-b6cb-d924c2b7e477 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:26.421157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c8bb0749-7b19-4c6e-b6cb-d924c2b7e477 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:26.945734 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-dad31140-f7fc-4f0e-a578-4d319f1493b5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:26.964624 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-dad31140-f7fc-4f0e-a578-4d319f1493b5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1368 microversion: 2.1 time: 0.604070 Aug 19 21:09:26.966425 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 91/167] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:26 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1368 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:26.981996 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c044f311-36fb-4096-933a-d14a601f4cea tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:26.990648 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-c8bb0749-7b19-4c6e-b6cb-d924c2b7e477 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:26.991587 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-c044f311-36fb-4096-933a-d14a601f4cea tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:27.000223 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-c8bb0749-7b19-4c6e-b6cb-d924c2b7e477 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1363 microversion: 2.1 time: 0.635362 Aug 19 21:09:27.001119 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 77/168] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:26 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1363 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:27.016105 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c044f311-36fb-4096-933a-d14a601f4cea tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:27.016632 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c044f311-36fb-4096-933a-d14a601f4cea tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:27.017073 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c044f311-36fb-4096-933a-d14a601f4cea tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:27.017808 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c044f311-36fb-4096-933a-d14a601f4cea tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:27.018274 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c044f311-36fb-4096-933a-d14a601f4cea tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:27.018692 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c044f311-36fb-4096-933a-d14a601f4cea tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:27.055052 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-11ed5d26-3457-467b-b2b5-c6cecca04238 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:27.056516 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-11ed5d26-3457-467b-b2b5-c6cecca04238 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:27.067495 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-11ed5d26-3457-467b-b2b5-c6cecca04238 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:27.068293 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-11ed5d26-3457-467b-b2b5-c6cecca04238 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:27.068906 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-11ed5d26-3457-467b-b2b5-c6cecca04238 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:27.070003 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-11ed5d26-3457-467b-b2b5-c6cecca04238 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:27.070789 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-11ed5d26-3457-467b-b2b5-c6cecca04238 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:27.071578 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-11ed5d26-3457-467b-b2b5-c6cecca04238 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:27.295543 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-11ed5d26-3457-467b-b2b5-c6cecca04238 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:27.295943 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c044f311-36fb-4096-933a-d14a601f4cea tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:27.304632 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-c044f311-36fb-4096-933a-d14a601f4cea tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.336351 Aug 19 21:09:27.305043 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-11ed5d26-3457-467b-b2b5-c6cecca04238 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:27.305698 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 92/169] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:26 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:27.306599 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-11ed5d26-3457-467b-b2b5-c6cecca04238 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:27.308086 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-11ed5d26-3457-467b-b2b5-c6cecca04238 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1406 microversion: 2.20 time: 0.260684 Aug 19 21:09:27.308298 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 78/170] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:27 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:09:27.989256 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a3ef764a-8e28-482b-8174-1eca6077e583 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:27.990786 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-a3ef764a-8e28-482b-8174-1eca6077e583 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:27.997139 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3ef764a-8e28-482b-8174-1eca6077e583 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:27.997816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3ef764a-8e28-482b-8174-1eca6077e583 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:27.998259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3ef764a-8e28-482b-8174-1eca6077e583 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:27.999172 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3ef764a-8e28-482b-8174-1eca6077e583 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:27.999667 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3ef764a-8e28-482b-8174-1eca6077e583 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:28.000095 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3ef764a-8e28-482b-8174-1eca6077e583 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:28.028780 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-3f5cb421-2cdc-4a9a-91d1-7a58dcddbc92 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:28.028780 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-3f5cb421-2cdc-4a9a-91d1-7a58dcddbc92 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:28.035767 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3f5cb421-2cdc-4a9a-91d1-7a58dcddbc92 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:28.036271 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3f5cb421-2cdc-4a9a-91d1-7a58dcddbc92 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:28.036787 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3f5cb421-2cdc-4a9a-91d1-7a58dcddbc92 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:28.037683 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3f5cb421-2cdc-4a9a-91d1-7a58dcddbc92 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:28.038202 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3f5cb421-2cdc-4a9a-91d1-7a58dcddbc92 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:28.038646 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3f5cb421-2cdc-4a9a-91d1-7a58dcddbc92 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:28.229592 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-a3ef764a-8e28-482b-8174-1eca6077e583 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:28.238356 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-a3ef764a-8e28-482b-8174-1eca6077e583 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1368 microversion: 2.1 time: 0.254649 Aug 19 21:09:28.238806 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 93/171] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:27 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:28.266188 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-3f5cb421-2cdc-4a9a-91d1-7a58dcddbc92 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:28.276640 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-3f5cb421-2cdc-4a9a-91d1-7a58dcddbc92 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1363 microversion: 2.1 time: 0.256924 Aug 19 21:09:28.277380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 79/172] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:28 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:28.330008 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a7372a66-68c3-42fa-95fd-2de362562346 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:28.330649 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-a7372a66-68c3-42fa-95fd-2de362562346 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:28.337757 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a7372a66-68c3-42fa-95fd-2de362562346 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:28.338543 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a7372a66-68c3-42fa-95fd-2de362562346 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:28.338979 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a7372a66-68c3-42fa-95fd-2de362562346 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:28.339698 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a7372a66-68c3-42fa-95fd-2de362562346 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:28.340157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a7372a66-68c3-42fa-95fd-2de362562346 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:28.340585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a7372a66-68c3-42fa-95fd-2de362562346 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:28.348646 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-330612fe-1cb5-453e-929e-05baa6b56c3f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:28.350521 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-330612fe-1cb5-453e-929e-05baa6b56c3f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:28.358937 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-330612fe-1cb5-453e-929e-05baa6b56c3f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:28.359697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-330612fe-1cb5-453e-929e-05baa6b56c3f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:28.360210 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-330612fe-1cb5-453e-929e-05baa6b56c3f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:28.361460 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-330612fe-1cb5-453e-929e-05baa6b56c3f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:28.362037 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-330612fe-1cb5-453e-929e-05baa6b56c3f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:28.363797 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-330612fe-1cb5-453e-929e-05baa6b56c3f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:28.644053 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-a7372a66-68c3-42fa-95fd-2de362562346 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:28.659378 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-a7372a66-68c3-42fa-95fd-2de362562346 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.333116 Aug 19 21:09:28.660502 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 94/173] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:28 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:28.663292 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-330612fe-1cb5-453e-929e-05baa6b56c3f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:28.681145 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-330612fe-1cb5-453e-929e-05baa6b56c3f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:28.682696 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-330612fe-1cb5-453e-929e-05baa6b56c3f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:28.683845 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-330612fe-1cb5-453e-929e-05baa6b56c3f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1406 microversion: 2.20 time: 0.342608 Aug 19 21:09:28.684607 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 80/174] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:28 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1406 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:09:29.260563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0d0260e5-e36c-46b4-a9aa-ececb82b9a55 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:29.261177 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0d0260e5-e36c-46b4-a9aa-ececb82b9a55 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:29.267123 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0d0260e5-e36c-46b4-a9aa-ececb82b9a55 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:29.267607 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0d0260e5-e36c-46b4-a9aa-ececb82b9a55 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:29.268072 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0d0260e5-e36c-46b4-a9aa-ececb82b9a55 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:29.268758 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0d0260e5-e36c-46b4-a9aa-ececb82b9a55 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:29.269212 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0d0260e5-e36c-46b4-a9aa-ececb82b9a55 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:29.269634 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0d0260e5-e36c-46b4-a9aa-ececb82b9a55 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:29.284506 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=100 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:29.300680 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-62887c57-c293-4d26-8fbe-3ad221df2dc6 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:29.301235 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-62887c57-c293-4d26-8fbe-3ad221df2dc6 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:29.308070 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-62887c57-c293-4d26-8fbe-3ad221df2dc6 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:29.308551 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-62887c57-c293-4d26-8fbe-3ad221df2dc6 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:29.308981 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-62887c57-c293-4d26-8fbe-3ad221df2dc6 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:29.309679 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-62887c57-c293-4d26-8fbe-3ad221df2dc6 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:29.310151 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-62887c57-c293-4d26-8fbe-3ad221df2dc6 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:29.310770 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-62887c57-c293-4d26-8fbe-3ad221df2dc6 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:29.471259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0d0260e5-e36c-46b4-a9aa-ececb82b9a55 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:29.480802 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0d0260e5-e36c-46b4-a9aa-ececb82b9a55 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1368 microversion: 2.1 time: 0.223867 Aug 19 21:09:29.481897 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 95/175] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:29 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:29.499324 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-62887c57-c293-4d26-8fbe-3ad221df2dc6 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:29.509180 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-62887c57-c293-4d26-8fbe-3ad221df2dc6 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1363 microversion: 2.1 time: 0.212371 Aug 19 21:09:29.509873 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 81/176] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:29 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:29.683320 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-1c845569-df76-4793-9873-28c60710771b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:29.683929 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-1c845569-df76-4793-9873-28c60710771b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:29.690052 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1c845569-df76-4793-9873-28c60710771b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:29.690547 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1c845569-df76-4793-9873-28c60710771b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:29.691018 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1c845569-df76-4793-9873-28c60710771b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:29.691721 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1c845569-df76-4793-9873-28c60710771b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:29.692175 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1c845569-df76-4793-9873-28c60710771b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:29.692609 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1c845569-df76-4793-9873-28c60710771b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:29.707984 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-0ce097c5-fd51-49ad-b2a4-eeb8d1960470 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:29.710420 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-0ce097c5-fd51-49ad-b2a4-eeb8d1960470 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:29.715472 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0ce097c5-fd51-49ad-b2a4-eeb8d1960470 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:29.716054 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0ce097c5-fd51-49ad-b2a4-eeb8d1960470 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:29.716575 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0ce097c5-fd51-49ad-b2a4-eeb8d1960470 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:29.718150 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0ce097c5-fd51-49ad-b2a4-eeb8d1960470 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:29.718694 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0ce097c5-fd51-49ad-b2a4-eeb8d1960470 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:29.719243 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0ce097c5-fd51-49ad-b2a4-eeb8d1960470 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:29.955573 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-0ce097c5-fd51-49ad-b2a4-eeb8d1960470 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:29.965495 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-0ce097c5-fd51-49ad-b2a4-eeb8d1960470 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:29.967450 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-0ce097c5-fd51-49ad-b2a4-eeb8d1960470 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:29.968952 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-0ce097c5-fd51-49ad-b2a4-eeb8d1960470 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1406 microversion: 2.20 time: 0.265060 Aug 19 21:09:29.969521 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 82/177] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:29 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:09:29.970664 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-1c845569-df76-4793-9873-28c60710771b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:29.979120 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-1c845569-df76-4793-9873-28c60710771b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.299863 Aug 19 21:09:29.980184 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 96/178] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:29 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:29.981255 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-05b0b917-ed0e-4e2f-b861-b6fd4003ec29 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "497974d9-0c13-41b6-838b-5d0e072c86ba"}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:09:29.991509 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-8939d682-02a5-4174-82ff-3ae5d558affc req-2b5fd8eb-b2a3-4297-9916-4f2d7c8d7b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e25852-2606-4138-b039-56a9ed0b7f1e", "name": "network-vif-plugged", "status": "completed", "tag": "e5fb615f-643a-4ed9-ae40-bd62d59a8fc5"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:09:29.998597 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-05b0b917-ed0e-4e2f-b861-b6fd4003ec29 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:30.006906 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-8939d682-02a5-4174-82ff-3ae5d558affc req-2b5fd8eb-b2a3-4297-9916-4f2d7c8d7b22 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:30.007114 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-05b0b917-ed0e-4e2f-b861-b6fd4003ec29 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:30.007446 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-05b0b917-ed0e-4e2f-b861-b6fd4003ec29 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:30.008138 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-8939d682-02a5-4174-82ff-3ae5d558affc req-2b5fd8eb-b2a3-4297-9916-4f2d7c8d7b22 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:30.008368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-05b0b917-ed0e-4e2f-b861-b6fd4003ec29 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:30.008919 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-8939d682-02a5-4174-82ff-3ae5d558affc req-2b5fd8eb-b2a3-4297-9916-4f2d7c8d7b22 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:30.009620 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-05b0b917-ed0e-4e2f-b861-b6fd4003ec29 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:30.010261 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-05b0b917-ed0e-4e2f-b861-b6fd4003ec29 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:30.010718 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-05b0b917-ed0e-4e2f-b861-b6fd4003ec29 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:30.025054 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-8939d682-02a5-4174-82ff-3ae5d558affc req-2b5fd8eb-b2a3-4297-9916-4f2d7c8d7b22 service nova] Creating event network-vif-plugged:e5fb615f-643a-4ed9-ae40-bd62d59a8fc5 for instance d7e25852-2606-4138-b039-56a9ed0b7f1e on hv-cinder-85220 Aug 19 21:09:30.031469 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-8939d682-02a5-4174-82ff-3ae5d558affc req-2b5fd8eb-b2a3-4297-9916-4f2d7c8d7b22 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049825 Aug 19 21:09:30.033247 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 97/179] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:09:30.504254 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-eab00bf3-8a0a-477f-8abb-d3866a809da5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:30.504991 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-eab00bf3-8a0a-477f-8abb-d3866a809da5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:30.512149 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eab00bf3-8a0a-477f-8abb-d3866a809da5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:30.512631 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eab00bf3-8a0a-477f-8abb-d3866a809da5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:30.513066 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eab00bf3-8a0a-477f-8abb-d3866a809da5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:30.513798 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eab00bf3-8a0a-477f-8abb-d3866a809da5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:30.514256 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eab00bf3-8a0a-477f-8abb-d3866a809da5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:30.514688 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eab00bf3-8a0a-477f-8abb-d3866a809da5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:30.667543 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-eab00bf3-8a0a-477f-8abb-d3866a809da5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:30.675902 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-eab00bf3-8a0a-477f-8abb-d3866a809da5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1368 microversion: 2.1 time: 0.176102 Aug 19 21:09:30.676496 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 98/180] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:30 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:30.681872 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-9b6f24e4-2c1b-45b2-a5f6-ac2d3aad88e0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:30.682485 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-9b6f24e4-2c1b-45b2-a5f6-ac2d3aad88e0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:30.688823 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9b6f24e4-2c1b-45b2-a5f6-ac2d3aad88e0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:30.689305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9b6f24e4-2c1b-45b2-a5f6-ac2d3aad88e0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:30.689738 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9b6f24e4-2c1b-45b2-a5f6-ac2d3aad88e0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:30.690479 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9b6f24e4-2c1b-45b2-a5f6-ac2d3aad88e0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:30.690930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9b6f24e4-2c1b-45b2-a5f6-ac2d3aad88e0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:30.691343 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9b6f24e4-2c1b-45b2-a5f6-ac2d3aad88e0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:30.829836 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-9b6f24e4-2c1b-45b2-a5f6-ac2d3aad88e0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:30.839282 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-9b6f24e4-2c1b-45b2-a5f6-ac2d3aad88e0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1363 microversion: 2.1 time: 0.161377 Aug 19 21:09:30.840378 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 99/181] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:30 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:30.992847 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-40fa5592-e80d-4113-8490-c3eeb1bf6653 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:30.993368 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-40fa5592-e80d-4113-8490-c3eeb1bf6653 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:31.001054 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-40fa5592-e80d-4113-8490-c3eeb1bf6653 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:31.001545 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-40fa5592-e80d-4113-8490-c3eeb1bf6653 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:31.002048 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-40fa5592-e80d-4113-8490-c3eeb1bf6653 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:31.008723 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-40fa5592-e80d-4113-8490-c3eeb1bf6653 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:31.008723 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-40fa5592-e80d-4113-8490-c3eeb1bf6653 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:31.008723 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-40fa5592-e80d-4113-8490-c3eeb1bf6653 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:31.148918 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-40fa5592-e80d-4113-8490-c3eeb1bf6653 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:31.157732 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-40fa5592-e80d-4113-8490-c3eeb1bf6653 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:31.159261 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-40fa5592-e80d-4113-8490-c3eeb1bf6653 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:31.160378 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-40fa5592-e80d-4113-8490-c3eeb1bf6653 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1406 microversion: 2.20 time: 0.172099 Aug 19 21:09:31.160960 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 100/182] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:30 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:09:31.165262 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-63ab509e-a7db-403a-a67c-c3a320c4ad45 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:31.165888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-63ab509e-a7db-403a-a67c-c3a320c4ad45 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:31.171839 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-63ab509e-a7db-403a-a67c-c3a320c4ad45 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:31.172314 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-63ab509e-a7db-403a-a67c-c3a320c4ad45 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:31.172753 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-63ab509e-a7db-403a-a67c-c3a320c4ad45 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:31.173434 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-63ab509e-a7db-403a-a67c-c3a320c4ad45 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:31.173914 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-63ab509e-a7db-403a-a67c-c3a320c4ad45 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:31.174340 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-63ab509e-a7db-403a-a67c-c3a320c4ad45 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:31.313941 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-63ab509e-a7db-403a-a67c-c3a320c4ad45 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:31.322149 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-63ab509e-a7db-403a-a67c-c3a320c4ad45 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.160208 Aug 19 21:09:31.322787 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 101/183] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:31 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:31.699086 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a8288b62-fe91-4c65-b8f9-987a2d2f1d35 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:31.700857 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-a8288b62-fe91-4c65-b8f9-987a2d2f1d35 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:31.717962 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a8288b62-fe91-4c65-b8f9-987a2d2f1d35 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:31.720140 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a8288b62-fe91-4c65-b8f9-987a2d2f1d35 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:31.721147 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a8288b62-fe91-4c65-b8f9-987a2d2f1d35 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:31.724796 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a8288b62-fe91-4c65-b8f9-987a2d2f1d35 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:31.725789 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a8288b62-fe91-4c65-b8f9-987a2d2f1d35 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:31.726912 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a8288b62-fe91-4c65-b8f9-987a2d2f1d35 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:31.942295 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-a8288b62-fe91-4c65-b8f9-987a2d2f1d35 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:31.962612 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-a8288b62-fe91-4c65-b8f9-987a2d2f1d35 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1368 microversion: 2.1 time: 0.267147 Aug 19 21:09:31.963575 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 102/184] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:31 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1368 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:31.984187 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-5405678a-bafd-45ec-9445-d8398509f6dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:31.984990 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-5405678a-bafd-45ec-9445-d8398509f6dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:31.992653 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5405678a-bafd-45ec-9445-d8398509f6dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:31.993425 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5405678a-bafd-45ec-9445-d8398509f6dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:31.994120 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5405678a-bafd-45ec-9445-d8398509f6dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:31.995124 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5405678a-bafd-45ec-9445-d8398509f6dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:31.995725 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5405678a-bafd-45ec-9445-d8398509f6dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:31.996306 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5405678a-bafd-45ec-9445-d8398509f6dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:32.202378 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-5405678a-bafd-45ec-9445-d8398509f6dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:32.210419 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-5405678a-bafd-45ec-9445-d8398509f6dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1363 microversion: 2.1 time: 0.230904 Aug 19 21:09:32.210985 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 103/185] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:31 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:32.216293 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e9021b43-85ae-47da-94a8-7419dabfe21c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:32.216561 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-e9021b43-85ae-47da-94a8-7419dabfe21c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:32.222762 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e9021b43-85ae-47da-94a8-7419dabfe21c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:32.223254 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e9021b43-85ae-47da-94a8-7419dabfe21c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:32.223682 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e9021b43-85ae-47da-94a8-7419dabfe21c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:32.224945 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e9021b43-85ae-47da-94a8-7419dabfe21c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:32.225393 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e9021b43-85ae-47da-94a8-7419dabfe21c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:32.225838 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e9021b43-85ae-47da-94a8-7419dabfe21c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:32.398524 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e9021b43-85ae-47da-94a8-7419dabfe21c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:32.408473 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e9021b43-85ae-47da-94a8-7419dabfe21c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:32.410407 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e9021b43-85ae-47da-94a8-7419dabfe21c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:32.412341 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e9021b43-85ae-47da-94a8-7419dabfe21c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1406 microversion: 2.20 time: 0.199624 Aug 19 21:09:32.413219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 104/186] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:32 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:09:32.418141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-34722fae-2660-4ec1-a977-45bdb55530be tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:32.419035 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-34722fae-2660-4ec1-a977-45bdb55530be tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:32.425495 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-34722fae-2660-4ec1-a977-45bdb55530be tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:32.426306 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-34722fae-2660-4ec1-a977-45bdb55530be tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:32.426902 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-34722fae-2660-4ec1-a977-45bdb55530be tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:32.428357 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-34722fae-2660-4ec1-a977-45bdb55530be tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:32.428995 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-34722fae-2660-4ec1-a977-45bdb55530be tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:32.429575 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-34722fae-2660-4ec1-a977-45bdb55530be tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:32.598857 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-34722fae-2660-4ec1-a977-45bdb55530be tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:32.607725 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-34722fae-2660-4ec1-a977-45bdb55530be tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.193145 Aug 19 21:09:32.608313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 105/187] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:32 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:32.988086 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-09bda518-14b9-43ed-83da-b7e022fa7e04 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:32.989275 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-09bda518-14b9-43ed-83da-b7e022fa7e04 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:32.998801 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-09bda518-14b9-43ed-83da-b7e022fa7e04 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:32.999614 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-09bda518-14b9-43ed-83da-b7e022fa7e04 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:33.000040 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-09bda518-14b9-43ed-83da-b7e022fa7e04 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:33.001007 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-09bda518-14b9-43ed-83da-b7e022fa7e04 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:33.001529 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-09bda518-14b9-43ed-83da-b7e022fa7e04 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:33.002074 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-09bda518-14b9-43ed-83da-b7e022fa7e04 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:33.180569 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-09bda518-14b9-43ed-83da-b7e022fa7e04 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:33.194923 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-09bda518-14b9-43ed-83da-b7e022fa7e04 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1368 microversion: 2.1 time: 0.212794 Aug 19 21:09:33.204333 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 106/188] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:32 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:33.232783 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-9ccfcc8b-d230-4c1e-8653-4645d87abd37 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:33.233416 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-9ccfcc8b-d230-4c1e-8653-4645d87abd37 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:33.240409 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9ccfcc8b-d230-4c1e-8653-4645d87abd37 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:33.241024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9ccfcc8b-d230-4c1e-8653-4645d87abd37 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:33.241304 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9ccfcc8b-d230-4c1e-8653-4645d87abd37 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:33.242209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9ccfcc8b-d230-4c1e-8653-4645d87abd37 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:33.242616 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9ccfcc8b-d230-4c1e-8653-4645d87abd37 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:33.243042 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9ccfcc8b-d230-4c1e-8653-4645d87abd37 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:33.392976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-9ccfcc8b-d230-4c1e-8653-4645d87abd37 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:33.403269 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-9ccfcc8b-d230-4c1e-8653-4645d87abd37 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1363 microversion: 2.1 time: 0.174432 Aug 19 21:09:33.403939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 107/189] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:33 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:33.436263 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-4df59254-99db-4a80-870b-d3c7e8ea93b0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:33.436870 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-4df59254-99db-4a80-870b-d3c7e8ea93b0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:33.444256 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4df59254-99db-4a80-870b-d3c7e8ea93b0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:33.444760 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4df59254-99db-4a80-870b-d3c7e8ea93b0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:33.445176 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4df59254-99db-4a80-870b-d3c7e8ea93b0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:33.445906 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4df59254-99db-4a80-870b-d3c7e8ea93b0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:33.446360 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4df59254-99db-4a80-870b-d3c7e8ea93b0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:33.446784 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4df59254-99db-4a80-870b-d3c7e8ea93b0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:33.598023 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-4df59254-99db-4a80-870b-d3c7e8ea93b0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:33.612398 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-4df59254-99db-4a80-870b-d3c7e8ea93b0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:33.616043 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-4df59254-99db-4a80-870b-d3c7e8ea93b0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:33.617890 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-4df59254-99db-4a80-870b-d3c7e8ea93b0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1406 microversion: 2.20 time: 0.185182 Aug 19 21:09:33.618828 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 108/190] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:33 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:09:33.631977 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-b45ae6bd-95b8-4589-b8ef-07a73d242bab tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:33.632705 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-b45ae6bd-95b8-4589-b8ef-07a73d242bab tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:33.639024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b45ae6bd-95b8-4589-b8ef-07a73d242bab tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:33.639602 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b45ae6bd-95b8-4589-b8ef-07a73d242bab tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:33.640033 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b45ae6bd-95b8-4589-b8ef-07a73d242bab tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:33.640727 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b45ae6bd-95b8-4589-b8ef-07a73d242bab tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:33.641176 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b45ae6bd-95b8-4589-b8ef-07a73d242bab tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:33.641715 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b45ae6bd-95b8-4589-b8ef-07a73d242bab tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:33.792953 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-b45ae6bd-95b8-4589-b8ef-07a73d242bab tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:33.801012 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-b45ae6bd-95b8-4589-b8ef-07a73d242bab tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.174038 Aug 19 21:09:33.801590 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 109/191] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:33 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:34.126673 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-55ba5a81-98b7-454d-9abb-036355e9b23f req-c3aa25d2-9ae3-43c2-a24a-f5cfe0bf8246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99339e5a-af6a-4d00-a02b-cec028b663ae", "name": "network-vif-plugged", "status": "completed", "tag": "31356ae8-39a1-429f-bfe4-d7a38947ed9f"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:09:34.151894 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-55ba5a81-98b7-454d-9abb-036355e9b23f req-c3aa25d2-9ae3-43c2-a24a-f5cfe0bf8246 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:34.152811 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-55ba5a81-98b7-454d-9abb-036355e9b23f req-c3aa25d2-9ae3-43c2-a24a-f5cfe0bf8246 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:34.153807 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-55ba5a81-98b7-454d-9abb-036355e9b23f req-c3aa25d2-9ae3-43c2-a24a-f5cfe0bf8246 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:34.178142 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-55ba5a81-98b7-454d-9abb-036355e9b23f req-c3aa25d2-9ae3-43c2-a24a-f5cfe0bf8246 service nova] Creating event network-vif-plugged:31356ae8-39a1-429f-bfe4-d7a38947ed9f for instance 99339e5a-af6a-4d00-a02b-cec028b663ae on hv-cinder-85220 Aug 19 21:09:34.188650 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-55ba5a81-98b7-454d-9abb-036355e9b23f req-c3aa25d2-9ae3-43c2-a24a-f5cfe0bf8246 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084757 Aug 19 21:09:34.189666 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 110/192] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:09:34.226187 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-dec47ce7-ec61-424d-8a21-0ac0188e83cb tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:34.227579 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-dec47ce7-ec61-424d-8a21-0ac0188e83cb tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:34.248885 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dec47ce7-ec61-424d-8a21-0ac0188e83cb tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:34.249390 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dec47ce7-ec61-424d-8a21-0ac0188e83cb tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:34.249889 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dec47ce7-ec61-424d-8a21-0ac0188e83cb tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:34.250772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dec47ce7-ec61-424d-8a21-0ac0188e83cb tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:34.251237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dec47ce7-ec61-424d-8a21-0ac0188e83cb tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:34.251659 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dec47ce7-ec61-424d-8a21-0ac0188e83cb tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:34.605250 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-dec47ce7-ec61-424d-8a21-0ac0188e83cb tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:34.620537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-dec47ce7-ec61-424d-8a21-0ac0188e83cb tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1368 microversion: 2.1 time: 0.405190 Aug 19 21:09:34.625629 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 111/193] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:34 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1368 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:34.650838 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-cafa1d0d-c5b8-4354-9593-fa36e9dcde96 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:34.651957 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-cafa1d0d-c5b8-4354-9593-fa36e9dcde96 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:34.672612 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cafa1d0d-c5b8-4354-9593-fa36e9dcde96 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:34.673247 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cafa1d0d-c5b8-4354-9593-fa36e9dcde96 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:34.673686 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cafa1d0d-c5b8-4354-9593-fa36e9dcde96 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:34.674449 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cafa1d0d-c5b8-4354-9593-fa36e9dcde96 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:34.674917 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cafa1d0d-c5b8-4354-9593-fa36e9dcde96 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:34.675330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cafa1d0d-c5b8-4354-9593-fa36e9dcde96 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:34.843322 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-05b0b917-ed0e-4e2f-b861-b6fd4003ec29 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "POST /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.870839 Aug 19 21:09:34.844519 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 83/194] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Aug 19 21:09:29 2022] POST /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905/os-volume_attachments => generated 194 bytes in 4874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:09:34.901489 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-f7ca0789-26c2-43f7-b8f0-e4419ef8291b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:34.903397 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-f7ca0789-26c2-43f7-b8f0-e4419ef8291b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:34.918517 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f7ca0789-26c2-43f7-b8f0-e4419ef8291b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:34.921263 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f7ca0789-26c2-43f7-b8f0-e4419ef8291b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:34.923861 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f7ca0789-26c2-43f7-b8f0-e4419ef8291b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:34.940968 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f7ca0789-26c2-43f7-b8f0-e4419ef8291b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:34.942074 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f7ca0789-26c2-43f7-b8f0-e4419ef8291b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:34.943103 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f7ca0789-26c2-43f7-b8f0-e4419ef8291b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:35.159627 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-cafa1d0d-c5b8-4354-9593-fa36e9dcde96 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:35.170281 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-cafa1d0d-c5b8-4354-9593-fa36e9dcde96 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1363 microversion: 2.1 time: 0.541460 Aug 19 21:09:35.187355 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 112/195] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:34 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1363 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:35.197957 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c5fa2038-5ed6-4ef7-bb8d-46210b901382 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:35.198958 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-c5fa2038-5ed6-4ef7-bb8d-46210b901382 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:35.201347 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=100 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:35.210277 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c5fa2038-5ed6-4ef7-bb8d-46210b901382 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:35.211136 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c5fa2038-5ed6-4ef7-bb8d-46210b901382 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:35.211800 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c5fa2038-5ed6-4ef7-bb8d-46210b901382 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:35.212882 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c5fa2038-5ed6-4ef7-bb8d-46210b901382 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:35.213651 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c5fa2038-5ed6-4ef7-bb8d-46210b901382 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:35.214344 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c5fa2038-5ed6-4ef7-bb8d-46210b901382 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:35.254181 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=100 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:35.348866 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-f7ca0789-26c2-43f7-b8f0-e4419ef8291b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:35.358165 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-f7ca0789-26c2-43f7-b8f0-e4419ef8291b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:35.359842 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-f7ca0789-26c2-43f7-b8f0-e4419ef8291b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:35.361402 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-f7ca0789-26c2-43f7-b8f0-e4419ef8291b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1406 microversion: 2.20 time: 0.515427 Aug 19 21:09:35.362082 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 84/196] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:34 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1406 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:09:35.452506 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c5fa2038-5ed6-4ef7-bb8d-46210b901382 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:35.464353 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-c5fa2038-5ed6-4ef7-bb8d-46210b901382 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.272283 Aug 19 21:09:35.465389 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 113/197] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:35 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:35.651039 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-5beed071-158d-4f73-9991-fd800406c07b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:35.651923 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-5beed071-158d-4f73-9991-fd800406c07b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:35.666950 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5beed071-158d-4f73-9991-fd800406c07b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:35.666950 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5beed071-158d-4f73-9991-fd800406c07b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:35.666950 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5beed071-158d-4f73-9991-fd800406c07b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:35.666950 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5beed071-158d-4f73-9991-fd800406c07b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:35.667748 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5beed071-158d-4f73-9991-fd800406c07b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:35.667748 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5beed071-158d-4f73-9991-fd800406c07b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:35.849992 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-5beed071-158d-4f73-9991-fd800406c07b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:35.862966 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-5beed071-158d-4f73-9991-fd800406c07b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1368 microversion: 2.1 time: 0.218327 Aug 19 21:09:35.863713 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 85/198] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:35 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:36.198898 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3dd7e15c-d448-47e7-a4df-73b66b636e85 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:36.200133 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-3dd7e15c-d448-47e7-a4df-73b66b636e85 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:36.207383 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3dd7e15c-d448-47e7-a4df-73b66b636e85 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:36.209567 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3dd7e15c-d448-47e7-a4df-73b66b636e85 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:36.210199 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3dd7e15c-d448-47e7-a4df-73b66b636e85 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:36.211153 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3dd7e15c-d448-47e7-a4df-73b66b636e85 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:36.211608 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3dd7e15c-d448-47e7-a4df-73b66b636e85 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:36.212192 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3dd7e15c-d448-47e7-a4df-73b66b636e85 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:36.385640 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-eae842dd-6fff-42df-864b-e04b79a9946a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:36.386728 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-eae842dd-6fff-42df-864b-e04b79a9946a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:36.391039 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3dd7e15c-d448-47e7-a4df-73b66b636e85 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:36.400031 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-eae842dd-6fff-42df-864b-e04b79a9946a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:36.403538 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-3dd7e15c-d448-47e7-a4df-73b66b636e85 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1363 microversion: 2.1 time: 0.208291 Aug 19 21:09:36.404203 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-eae842dd-6fff-42df-864b-e04b79a9946a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:36.404470 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 114/199] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:36 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:36.404782 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-eae842dd-6fff-42df-864b-e04b79a9946a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:36.405610 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-eae842dd-6fff-42df-864b-e04b79a9946a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:36.406185 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-eae842dd-6fff-42df-864b-e04b79a9946a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:36.406561 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-eae842dd-6fff-42df-864b-e04b79a9946a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:36.485679 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-cf0797dc-d8ba-4ac7-b72c-1776c9a40848 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:36.486329 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-cf0797dc-d8ba-4ac7-b72c-1776c9a40848 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:36.510879 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cf0797dc-d8ba-4ac7-b72c-1776c9a40848 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:36.511765 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cf0797dc-d8ba-4ac7-b72c-1776c9a40848 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:36.512431 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cf0797dc-d8ba-4ac7-b72c-1776c9a40848 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:36.513395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cf0797dc-d8ba-4ac7-b72c-1776c9a40848 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:36.524333 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cf0797dc-d8ba-4ac7-b72c-1776c9a40848 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:36.526168 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cf0797dc-d8ba-4ac7-b72c-1776c9a40848 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:36.666625 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-eae842dd-6fff-42df-864b-e04b79a9946a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:36.681367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-eae842dd-6fff-42df-864b-e04b79a9946a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:36.683122 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-eae842dd-6fff-42df-864b-e04b79a9946a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:36.684568 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-eae842dd-6fff-42df-864b-e04b79a9946a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1406 microversion: 2.20 time: 0.303022 Aug 19 21:09:36.685869 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 86/200] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:36 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:09:36.767940 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-cf0797dc-d8ba-4ac7-b72c-1776c9a40848 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:36.794280 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-cf0797dc-d8ba-4ac7-b72c-1776c9a40848 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.311944 Aug 19 21:09:36.796631 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 115/201] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:36 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:36.885225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-7fd7bce3-29cb-4193-b995-b00b3dd12ef4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:36.886107 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-7fd7bce3-29cb-4193-b995-b00b3dd12ef4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:36.893245 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7fd7bce3-29cb-4193-b995-b00b3dd12ef4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:36.893732 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7fd7bce3-29cb-4193-b995-b00b3dd12ef4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:36.898618 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7fd7bce3-29cb-4193-b995-b00b3dd12ef4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:36.899457 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7fd7bce3-29cb-4193-b995-b00b3dd12ef4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:36.900729 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7fd7bce3-29cb-4193-b995-b00b3dd12ef4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:36.901342 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7fd7bce3-29cb-4193-b995-b00b3dd12ef4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:37.137479 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-7fd7bce3-29cb-4193-b995-b00b3dd12ef4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:37.148232 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-7fd7bce3-29cb-4193-b995-b00b3dd12ef4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1368 microversion: 2.1 time: 0.266610 Aug 19 21:09:37.148936 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 87/202] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:36 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1368 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:37.426156 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-1536f11d-d5b5-4158-b9ed-35a3145b833a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:37.426827 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-1536f11d-d5b5-4158-b9ed-35a3145b833a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:37.434326 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1536f11d-d5b5-4158-b9ed-35a3145b833a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:37.435019 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1536f11d-d5b5-4158-b9ed-35a3145b833a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:37.435201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1536f11d-d5b5-4158-b9ed-35a3145b833a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:37.435854 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1536f11d-d5b5-4158-b9ed-35a3145b833a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:37.436314 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1536f11d-d5b5-4158-b9ed-35a3145b833a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:37.436739 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1536f11d-d5b5-4158-b9ed-35a3145b833a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:37.716271 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-1726aba1-75a6-45e1-abb9-43049c725d65 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:37.717097 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-1726aba1-75a6-45e1-abb9-43049c725d65 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:37.721665 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-1536f11d-d5b5-4158-b9ed-35a3145b833a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:37.725296 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1726aba1-75a6-45e1-abb9-43049c725d65 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:37.726060 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1726aba1-75a6-45e1-abb9-43049c725d65 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:37.726689 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1726aba1-75a6-45e1-abb9-43049c725d65 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:37.727594 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1726aba1-75a6-45e1-abb9-43049c725d65 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:37.728294 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1726aba1-75a6-45e1-abb9-43049c725d65 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:37.728870 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1726aba1-75a6-45e1-abb9-43049c725d65 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:37.753127 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-1536f11d-d5b5-4158-b9ed-35a3145b833a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1363 microversion: 2.1 time: 0.328925 Aug 19 21:09:37.756025 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 116/203] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:37 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1363 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:37.829798 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-5b3bdab7-ea0e-431e-b540-25511d0bf190 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:37.830602 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-5b3bdab7-ea0e-431e-b540-25511d0bf190 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:37.838198 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5b3bdab7-ea0e-431e-b540-25511d0bf190 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:37.839443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5b3bdab7-ea0e-431e-b540-25511d0bf190 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:37.840687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5b3bdab7-ea0e-431e-b540-25511d0bf190 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:37.841522 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5b3bdab7-ea0e-431e-b540-25511d0bf190 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:37.842347 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5b3bdab7-ea0e-431e-b540-25511d0bf190 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:37.842999 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5b3bdab7-ea0e-431e-b540-25511d0bf190 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:38.148788 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-1726aba1-75a6-45e1-abb9-43049c725d65 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:38.166356 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-1726aba1-75a6-45e1-abb9-43049c725d65 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:38.169803 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-1726aba1-75a6-45e1-abb9-43049c725d65 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:38.171520 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-1726aba1-75a6-45e1-abb9-43049c725d65 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1406 microversion: 2.20 time: 0.460964 Aug 19 21:09:38.172206 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 88/204] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:37 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1406 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:09:38.179933 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-04fca147-a12e-40f4-b26b-86b2dfda37f9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:38.181403 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-04fca147-a12e-40f4-b26b-86b2dfda37f9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:38.188031 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-5b3bdab7-ea0e-431e-b540-25511d0bf190 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:38.189170 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-04fca147-a12e-40f4-b26b-86b2dfda37f9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:38.189677 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-04fca147-a12e-40f4-b26b-86b2dfda37f9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:38.190257 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-04fca147-a12e-40f4-b26b-86b2dfda37f9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:38.191428 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-04fca147-a12e-40f4-b26b-86b2dfda37f9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:38.191913 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-04fca147-a12e-40f4-b26b-86b2dfda37f9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:38.193055 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-04fca147-a12e-40f4-b26b-86b2dfda37f9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:38.209185 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-5b3bdab7-ea0e-431e-b540-25511d0bf190 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.381591 Aug 19 21:09:38.221492 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 117/205] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:37 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:38.451467 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-04fca147-a12e-40f4-b26b-86b2dfda37f9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:38.472895 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-04fca147-a12e-40f4-b26b-86b2dfda37f9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1368 microversion: 2.1 time: 0.298711 Aug 19 21:09:38.489320 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 89/206] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:38 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1368 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:38.589310 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-e8083cd8-b90d-40ae-ac98-531fef177857 req-3e00498d-cb60-496a-be95-b8641d6ade61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95c060a-e4cc-436c-a185-9345fd2c44f2", "name": "network-vif-plugged", "status": "completed", "tag": "c65527c3-278b-404c-9369-abd76c37a0b5"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:09:38.610529 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-e8083cd8-b90d-40ae-ac98-531fef177857 req-3e00498d-cb60-496a-be95-b8641d6ade61 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:38.611288 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-e8083cd8-b90d-40ae-ac98-531fef177857 req-3e00498d-cb60-496a-be95-b8641d6ade61 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:38.612179 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-e8083cd8-b90d-40ae-ac98-531fef177857 req-3e00498d-cb60-496a-be95-b8641d6ade61 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:38.648728 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-e8083cd8-b90d-40ae-ac98-531fef177857 req-3e00498d-cb60-496a-be95-b8641d6ade61 service nova] Creating event network-vif-plugged:c65527c3-278b-404c-9369-abd76c37a0b5 for instance f95c060a-e4cc-436c-a185-9345fd2c44f2 on hv-cinder-85220 Aug 19 21:09:38.659252 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-e8083cd8-b90d-40ae-ac98-531fef177857 req-3e00498d-cb60-496a-be95-b8641d6ade61 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070165 Aug 19 21:09:38.660734 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 118/207] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:09:38.785618 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-0bdcbf54-ed5f-4b0e-a247-81a60508b31d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:38.786807 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-0bdcbf54-ed5f-4b0e-a247-81a60508b31d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:38.806900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0bdcbf54-ed5f-4b0e-a247-81a60508b31d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:38.807404 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0bdcbf54-ed5f-4b0e-a247-81a60508b31d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:38.807837 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0bdcbf54-ed5f-4b0e-a247-81a60508b31d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:38.808573 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0bdcbf54-ed5f-4b0e-a247-81a60508b31d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:38.809006 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0bdcbf54-ed5f-4b0e-a247-81a60508b31d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:38.809609 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0bdcbf54-ed5f-4b0e-a247-81a60508b31d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:39.084966 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-0bdcbf54-ed5f-4b0e-a247-81a60508b31d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:39.097931 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-0bdcbf54-ed5f-4b0e-a247-81a60508b31d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1549 microversion: 2.1 time: 0.315933 Aug 19 21:09:39.102493 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 90/208] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:38 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1549 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:39.118869 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-23a99065-e817-4c13-a3ee-1cbda720a9c6 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:39.119556 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-23a99065-e817-4c13-a3ee-1cbda720a9c6 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:39.127390 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-23a99065-e817-4c13-a3ee-1cbda720a9c6 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:39.128248 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-23a99065-e817-4c13-a3ee-1cbda720a9c6 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:39.128928 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-23a99065-e817-4c13-a3ee-1cbda720a9c6 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:39.130205 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-23a99065-e817-4c13-a3ee-1cbda720a9c6 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:39.130843 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-23a99065-e817-4c13-a3ee-1cbda720a9c6 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:39.131493 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-23a99065-e817-4c13-a3ee-1cbda720a9c6 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:39.196937 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-71f98c06-ce17-46c4-abc2-86bd562da9bb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:39.197847 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-71f98c06-ce17-46c4-abc2-86bd562da9bb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:39.209947 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71f98c06-ce17-46c4-abc2-86bd562da9bb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:39.211745 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71f98c06-ce17-46c4-abc2-86bd562da9bb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:39.212882 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71f98c06-ce17-46c4-abc2-86bd562da9bb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:39.215010 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71f98c06-ce17-46c4-abc2-86bd562da9bb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:39.216614 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71f98c06-ce17-46c4-abc2-86bd562da9bb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:39.218281 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71f98c06-ce17-46c4-abc2-86bd562da9bb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:39.413840 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-23a99065-e817-4c13-a3ee-1cbda720a9c6 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.299512 Aug 19 21:09:39.416543 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 119/209] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Aug 19 21:09:39 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e/os-interface => generated 284 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:09:39.436207 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-984188a2-c2b1-48f4-bbd9-6bcea6a3097d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:39.442125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-984188a2-c2b1-48f4-bbd9-6bcea6a3097d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:39.463988 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-984188a2-c2b1-48f4-bbd9-6bcea6a3097d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:39.469464 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-984188a2-c2b1-48f4-bbd9-6bcea6a3097d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:39.470775 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-984188a2-c2b1-48f4-bbd9-6bcea6a3097d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:39.472274 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-984188a2-c2b1-48f4-bbd9-6bcea6a3097d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:39.475633 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-984188a2-c2b1-48f4-bbd9-6bcea6a3097d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:39.477453 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-984188a2-c2b1-48f4-bbd9-6bcea6a3097d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:39.947288 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-71f98c06-ce17-46c4-abc2-86bd562da9bb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:39.974863 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-71f98c06-ce17-46c4-abc2-86bd562da9bb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:39.976799 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-71f98c06-ce17-46c4-abc2-86bd562da9bb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:39.978224 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-71f98c06-ce17-46c4-abc2-86bd562da9bb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1406 microversion: 2.20 time: 0.786559 Aug 19 21:09:39.979287 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 91/210] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:39 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1406 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:09:39.984900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-4b90b32e-a563-4b02-8deb-f1838426e879 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:39.986019 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-4b90b32e-a563-4b02-8deb-f1838426e879 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:39.993757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4b90b32e-a563-4b02-8deb-f1838426e879 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:39.994301 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4b90b32e-a563-4b02-8deb-f1838426e879 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:39.994820 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4b90b32e-a563-4b02-8deb-f1838426e879 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:39.995500 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4b90b32e-a563-4b02-8deb-f1838426e879 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:39.995938 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4b90b32e-a563-4b02-8deb-f1838426e879 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:39.996360 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4b90b32e-a563-4b02-8deb-f1838426e879 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:40.000780 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:40.359151 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-984188a2-c2b1-48f4-bbd9-6bcea6a3097d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:40.371281 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-984188a2-c2b1-48f4-bbd9-6bcea6a3097d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.953181 Aug 19 21:09:40.372538 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 120/211] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:39 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:40.670295 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-4b90b32e-a563-4b02-8deb-f1838426e879 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:40.682193 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-4b90b32e-a563-4b02-8deb-f1838426e879 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1557 microversion: 2.1 time: 0.701588 Aug 19 21:09:40.698344 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 92/212] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:39 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1557 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:40.706920 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-f9db4db8-b277-4a08-9f5e-46cc3d6a9f29 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:40.706920 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-f9db4db8-b277-4a08-9f5e-46cc3d6a9f29 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:40.714827 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f9db4db8-b277-4a08-9f5e-46cc3d6a9f29 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:40.715272 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f9db4db8-b277-4a08-9f5e-46cc3d6a9f29 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:40.715709 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f9db4db8-b277-4a08-9f5e-46cc3d6a9f29 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:40.716421 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f9db4db8-b277-4a08-9f5e-46cc3d6a9f29 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:40.716879 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f9db4db8-b277-4a08-9f5e-46cc3d6a9f29 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:40.717302 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f9db4db8-b277-4a08-9f5e-46cc3d6a9f29 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:40.897244 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-f9db4db8-b277-4a08-9f5e-46cc3d6a9f29 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.194538 Aug 19 21:09:40.899035 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 121/213] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Aug 19 21:09:40 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae/os-interface => generated 284 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:09:41.005403 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d5435f3f-79c9-4ff1-98f5-5bc683856a8c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:41.006659 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-d5435f3f-79c9-4ff1-98f5-5bc683856a8c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:41.014472 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d5435f3f-79c9-4ff1-98f5-5bc683856a8c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:41.015371 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d5435f3f-79c9-4ff1-98f5-5bc683856a8c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:41.015812 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d5435f3f-79c9-4ff1-98f5-5bc683856a8c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:41.017227 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d5435f3f-79c9-4ff1-98f5-5bc683856a8c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:41.017944 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d5435f3f-79c9-4ff1-98f5-5bc683856a8c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:41.018350 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d5435f3f-79c9-4ff1-98f5-5bc683856a8c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:41.412934 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-abaa8433-3fe0-4ad4-8984-c6eca381446b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:41.415539 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-abaa8433-3fe0-4ad4-8984-c6eca381446b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:41.428889 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-d5435f3f-79c9-4ff1-98f5-5bc683856a8c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:41.432192 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-abaa8433-3fe0-4ad4-8984-c6eca381446b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:41.433081 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-abaa8433-3fe0-4ad4-8984-c6eca381446b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:41.434233 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-abaa8433-3fe0-4ad4-8984-c6eca381446b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:41.438339 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-abaa8433-3fe0-4ad4-8984-c6eca381446b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:41.439229 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-abaa8433-3fe0-4ad4-8984-c6eca381446b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:41.446680 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-d5435f3f-79c9-4ff1-98f5-5bc683856a8c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:41.447138 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-abaa8433-3fe0-4ad4-8984-c6eca381446b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:41.450827 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-d5435f3f-79c9-4ff1-98f5-5bc683856a8c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:41.455311 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-d5435f3f-79c9-4ff1-98f5-5bc683856a8c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1406 microversion: 2.20 time: 0.454366 Aug 19 21:09:41.472319 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 93/214] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:40 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1406 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:09:41.901049 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-abaa8433-3fe0-4ad4-8984-c6eca381446b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:41.915863 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-abaa8433-3fe0-4ad4-8984-c6eca381446b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.506906 Aug 19 21:09:41.929925 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 122/215] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:41 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:42.272267 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-fcdf9c23-f33a-4fc9-82b7-9d36904f39bc req-9d52766e-8a63-4996-ab3c-1218906d1351 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e25852-2606-4138-b039-56a9ed0b7f1e", "tag": "e5fb615f-643a-4ed9-ae40-bd62d59a8fc5"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:09:42.285531 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-fcdf9c23-f33a-4fc9-82b7-9d36904f39bc req-9d52766e-8a63-4996-ab3c-1218906d1351 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:42.286545 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-fcdf9c23-f33a-4fc9-82b7-9d36904f39bc req-9d52766e-8a63-4996-ab3c-1218906d1351 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:42.287514 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-fcdf9c23-f33a-4fc9-82b7-9d36904f39bc req-9d52766e-8a63-4996-ab3c-1218906d1351 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:42.311368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-fcdf9c23-f33a-4fc9-82b7-9d36904f39bc req-9d52766e-8a63-4996-ab3c-1218906d1351 service nova] Creating event network-changed:e5fb615f-643a-4ed9-ae40-bd62d59a8fc5 for instance d7e25852-2606-4138-b039-56a9ed0b7f1e on hv-cinder-85220 Aug 19 21:09:42.324213 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-fcdf9c23-f33a-4fc9-82b7-9d36904f39bc req-9d52766e-8a63-4996-ab3c-1218906d1351 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058145 Aug 19 21:09:42.325412 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 94/216] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:09:42.494792 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-d5f69b60-2943-45a5-9e26-8f6b5f81cb56 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:42.496260 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-d5f69b60-2943-45a5-9e26-8f6b5f81cb56 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:42.503770 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d5f69b60-2943-45a5-9e26-8f6b5f81cb56 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:42.504773 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d5f69b60-2943-45a5-9e26-8f6b5f81cb56 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:42.505988 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d5f69b60-2943-45a5-9e26-8f6b5f81cb56 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:42.506889 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d5f69b60-2943-45a5-9e26-8f6b5f81cb56 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:42.507365 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d5f69b60-2943-45a5-9e26-8f6b5f81cb56 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:42.507793 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d5f69b60-2943-45a5-9e26-8f6b5f81cb56 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:42.746881 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-d5f69b60-2943-45a5-9e26-8f6b5f81cb56 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:42.761935 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-d5f69b60-2943-45a5-9e26-8f6b5f81cb56 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:42.764315 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-d5f69b60-2943-45a5-9e26-8f6b5f81cb56 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:42.765748 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-d5f69b60-2943-45a5-9e26-8f6b5f81cb56 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1597 microversion: 2.20 time: 0.287310 Aug 19 21:09:42.766492 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 123/217] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:09:42 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1597 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:09:42.816621 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-94df1400-a9ec-4a5a-9b3d-726949a6ad95 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:42.818777 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-94df1400-a9ec-4a5a-9b3d-726949a6ad95 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:42.832110 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-94df1400-a9ec-4a5a-9b3d-726949a6ad95 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:42.837025 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-94df1400-a9ec-4a5a-9b3d-726949a6ad95 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:42.838071 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-94df1400-a9ec-4a5a-9b3d-726949a6ad95 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:42.839262 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-94df1400-a9ec-4a5a-9b3d-726949a6ad95 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:42.840154 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-94df1400-a9ec-4a5a-9b3d-726949a6ad95 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:42.841276 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-94df1400-a9ec-4a5a-9b3d-726949a6ad95 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:42.943932 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-4510a687-59bf-4d33-9e37-a3203016927f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:42.944619 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-4510a687-59bf-4d33-9e37-a3203016927f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:42.956369 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-94df1400-a9ec-4a5a-9b3d-726949a6ad95 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.148078 Aug 19 21:09:42.957200 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 95/218] 10.222.0.16 () {60 vars in 1316 bytes} [Fri Aug 19 21:09:42 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 21:09:42.972252 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4510a687-59bf-4d33-9e37-a3203016927f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:42.972862 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4510a687-59bf-4d33-9e37-a3203016927f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:42.973249 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4510a687-59bf-4d33-9e37-a3203016927f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:42.982535 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4510a687-59bf-4d33-9e37-a3203016927f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:42.985344 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4510a687-59bf-4d33-9e37-a3203016927f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:42.990438 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4510a687-59bf-4d33-9e37-a3203016927f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:43.395058 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-9c05210f-2dc1-4647-93f9-337050a36cfb req-4d7d7747-09b8-4532-8027-51870a2430b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99339e5a-af6a-4d00-a02b-cec028b663ae", "tag": "31356ae8-39a1-429f-bfe4-d7a38947ed9f"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:09:43.414031 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-9c05210f-2dc1-4647-93f9-337050a36cfb req-4d7d7747-09b8-4532-8027-51870a2430b7 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:43.417093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-9c05210f-2dc1-4647-93f9-337050a36cfb req-4d7d7747-09b8-4532-8027-51870a2430b7 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:43.423470 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-9c05210f-2dc1-4647-93f9-337050a36cfb req-4d7d7747-09b8-4532-8027-51870a2430b7 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:43.451899 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-9c05210f-2dc1-4647-93f9-337050a36cfb req-4d7d7747-09b8-4532-8027-51870a2430b7 service nova] Creating event network-changed:31356ae8-39a1-429f-bfe4-d7a38947ed9f for instance 99339e5a-af6a-4d00-a02b-cec028b663ae on hv-cinder-85220 Aug 19 21:09:43.458224 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-9c05210f-2dc1-4647-93f9-337050a36cfb req-4d7d7747-09b8-4532-8027-51870a2430b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068833 Aug 19 21:09:43.459951 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 96/219] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:09:43.708021 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-4510a687-59bf-4d33-9e37-a3203016927f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:43.725660 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-4510a687-59bf-4d33-9e37-a3203016927f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.790644 Aug 19 21:09:43.741254 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 124/220] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:42 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:44.748518 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-6c3bd580-9ab1-423e-9a2f-666d9bc5b3bc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:44.749233 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-6c3bd580-9ab1-423e-9a2f-666d9bc5b3bc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:44.758258 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6c3bd580-9ab1-423e-9a2f-666d9bc5b3bc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:44.759091 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6c3bd580-9ab1-423e-9a2f-666d9bc5b3bc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:44.759626 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6c3bd580-9ab1-423e-9a2f-666d9bc5b3bc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:44.760418 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6c3bd580-9ab1-423e-9a2f-666d9bc5b3bc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:44.760990 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6c3bd580-9ab1-423e-9a2f-666d9bc5b3bc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:44.761379 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6c3bd580-9ab1-423e-9a2f-666d9bc5b3bc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:44.976958 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-6c3bd580-9ab1-423e-9a2f-666d9bc5b3bc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:44.990103 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-6c3bd580-9ab1-423e-9a2f-666d9bc5b3bc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.244954 Aug 19 21:09:45.006703 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 97/221] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:44 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:45.474626 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-c815e50b-ba02-4ae8-9b90-93bc152aa6ef req-aced53ea-9a72-4537-893c-afb7c4b217bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f95c060a-e4cc-436c-a185-9345fd2c44f2", "tag": "c65527c3-278b-404c-9369-abd76c37a0b5"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:09:45.484138 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-c815e50b-ba02-4ae8-9b90-93bc152aa6ef req-aced53ea-9a72-4537-893c-afb7c4b217bb service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:45.484620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-c815e50b-ba02-4ae8-9b90-93bc152aa6ef req-aced53ea-9a72-4537-893c-afb7c4b217bb service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:45.485050 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-c815e50b-ba02-4ae8-9b90-93bc152aa6ef req-aced53ea-9a72-4537-893c-afb7c4b217bb service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:45.500983 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-c815e50b-ba02-4ae8-9b90-93bc152aa6ef req-aced53ea-9a72-4537-893c-afb7c4b217bb service nova] Creating event network-changed:c65527c3-278b-404c-9369-abd76c37a0b5 for instance f95c060a-e4cc-436c-a185-9345fd2c44f2 on hv-cinder-85220 Aug 19 21:09:45.508260 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-c815e50b-ba02-4ae8-9b90-93bc152aa6ef req-aced53ea-9a72-4537-893c-afb7c4b217bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037688 Aug 19 21:09:45.509023 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 125/222] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:09:46.012657 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-2fae91cc-b628-4167-9010-efc4ae3b0920 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:46.013446 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-2fae91cc-b628-4167-9010-efc4ae3b0920 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:46.022533 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2fae91cc-b628-4167-9010-efc4ae3b0920 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:46.023100 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2fae91cc-b628-4167-9010-efc4ae3b0920 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:46.023744 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2fae91cc-b628-4167-9010-efc4ae3b0920 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:46.025179 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2fae91cc-b628-4167-9010-efc4ae3b0920 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:46.025876 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2fae91cc-b628-4167-9010-efc4ae3b0920 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:46.026593 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2fae91cc-b628-4167-9010-efc4ae3b0920 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:46.224547 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-2fae91cc-b628-4167-9010-efc4ae3b0920 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:46.238052 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-2fae91cc-b628-4167-9010-efc4ae3b0920 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.228974 Aug 19 21:09:46.238792 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 98/223] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:46 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:47.260482 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-6b9a01c6-3755-4617-849c-cb73b39a18fd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:47.261513 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-6b9a01c6-3755-4617-849c-cb73b39a18fd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:47.268216 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6b9a01c6-3755-4617-849c-cb73b39a18fd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:47.268811 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6b9a01c6-3755-4617-849c-cb73b39a18fd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:47.269258 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6b9a01c6-3755-4617-849c-cb73b39a18fd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:47.270022 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6b9a01c6-3755-4617-849c-cb73b39a18fd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:47.270601 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6b9a01c6-3755-4617-849c-cb73b39a18fd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:47.271049 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6b9a01c6-3755-4617-849c-cb73b39a18fd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:47.432932 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-6b9a01c6-3755-4617-849c-cb73b39a18fd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:47.442144 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-6b9a01c6-3755-4617-849c-cb73b39a18fd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.185847 Aug 19 21:09:47.443450 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 126/224] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:47 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:48.357972 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-89fc6d1f-dab6-40fe-ac28-7a730cd68080 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:48.358608 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-89fc6d1f-dab6-40fe-ac28-7a730cd68080 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:48.360792 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=72 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:48.366481 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-89fc6d1f-dab6-40fe-ac28-7a730cd68080 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:48.366971 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-89fc6d1f-dab6-40fe-ac28-7a730cd68080 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:48.367405 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-89fc6d1f-dab6-40fe-ac28-7a730cd68080 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:48.368097 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-89fc6d1f-dab6-40fe-ac28-7a730cd68080 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:48.368546 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-89fc6d1f-dab6-40fe-ac28-7a730cd68080 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:48.368964 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-89fc6d1f-dab6-40fe-ac28-7a730cd68080 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:48.397104 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-89fc6d1f-dab6-40fe-ac28-7a730cd68080 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Going to try to terminate instance {{(pid=120876) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 21:09:48.464944 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-feb2f661-27bd-4c26-b683-4d55fc81d543 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:48.465616 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-feb2f661-27bd-4c26-b683-4d55fc81d543 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:48.478397 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-feb2f661-27bd-4c26-b683-4d55fc81d543 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:48.479170 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-feb2f661-27bd-4c26-b683-4d55fc81d543 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:48.479769 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-feb2f661-27bd-4c26-b683-4d55fc81d543 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:48.480654 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-feb2f661-27bd-4c26-b683-4d55fc81d543 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:48.481260 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-feb2f661-27bd-4c26-b683-4d55fc81d543 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:48.481871 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-feb2f661-27bd-4c26-b683-4d55fc81d543 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:48.497043 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-89fc6d1f-dab6-40fe-ac28-7a730cd68080 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 204 len: 0 microversion: 2.1 time: 0.142156 Aug 19 21:09:48.498417 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 99/225] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:09:48 2022] DELETE /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 21:09:48.513890 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-8d81ba39-3630-4b95-8d25-13b4590220a7 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:48.515236 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-8d81ba39-3630-4b95-8d25-13b4590220a7 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:48.525719 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8d81ba39-3630-4b95-8d25-13b4590220a7 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:48.526251 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8d81ba39-3630-4b95-8d25-13b4590220a7 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:48.526673 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8d81ba39-3630-4b95-8d25-13b4590220a7 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:48.528288 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8d81ba39-3630-4b95-8d25-13b4590220a7 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:48.528759 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8d81ba39-3630-4b95-8d25-13b4590220a7 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:48.529182 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8d81ba39-3630-4b95-8d25-13b4590220a7 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:48.710438 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-feb2f661-27bd-4c26-b683-4d55fc81d543 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:48.718844 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-feb2f661-27bd-4c26-b683-4d55fc81d543 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.257946 Aug 19 21:09:48.719774 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 127/226] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:48 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:48.748866 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-8d81ba39-3630-4b95-8d25-13b4590220a7 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:48.758942 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-8d81ba39-3630-4b95-8d25-13b4590220a7 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1554 microversion: 2.1 time: 0.253042 Aug 19 21:09:48.759550 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 100/227] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:48 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1554 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:49.741217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-627fe6d3-db10-4c67-aabc-c44ddeaef243 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:49.741910 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-627fe6d3-db10-4c67-aabc-c44ddeaef243 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:49.748555 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-627fe6d3-db10-4c67-aabc-c44ddeaef243 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:49.749039 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-627fe6d3-db10-4c67-aabc-c44ddeaef243 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:49.749472 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-627fe6d3-db10-4c67-aabc-c44ddeaef243 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:49.750219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-627fe6d3-db10-4c67-aabc-c44ddeaef243 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:49.750676 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-627fe6d3-db10-4c67-aabc-c44ddeaef243 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:49.751091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-627fe6d3-db10-4c67-aabc-c44ddeaef243 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:49.782633 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-85fa6c2e-2b08-4fa0-a22c-c2bc9de20e8d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:49.783829 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-85fa6c2e-2b08-4fa0-a22c-c2bc9de20e8d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:49.793051 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-85fa6c2e-2b08-4fa0-a22c-c2bc9de20e8d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:49.793568 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-85fa6c2e-2b08-4fa0-a22c-c2bc9de20e8d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:49.794134 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-85fa6c2e-2b08-4fa0-a22c-c2bc9de20e8d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:49.794921 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-85fa6c2e-2b08-4fa0-a22c-c2bc9de20e8d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:49.795451 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-85fa6c2e-2b08-4fa0-a22c-c2bc9de20e8d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:49.795974 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-85fa6c2e-2b08-4fa0-a22c-c2bc9de20e8d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:49.998325 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-627fe6d3-db10-4c67-aabc-c44ddeaef243 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:50.006626 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-85fa6c2e-2b08-4fa0-a22c-c2bc9de20e8d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:50.007114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-627fe6d3-db10-4c67-aabc-c44ddeaef243 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.270036 Aug 19 21:09:50.007704 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 128/228] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:49 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:50.015940 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-85fa6c2e-2b08-4fa0-a22c-c2bc9de20e8d tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1554 microversion: 2.1 time: 0.238430 Aug 19 21:09:50.016513 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 101/229] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:49 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1554 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:51.031480 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ec2675dc-ffb4-440e-af83-c8278cab4bd9 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:51.032022 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ec2675dc-ffb4-440e-af83-c8278cab4bd9 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:51.040897 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ec2675dc-ffb4-440e-af83-c8278cab4bd9 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:51.041149 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-2b26b703-25e6-45f3-ba73-6bef437f8621 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:51.041601 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ec2675dc-ffb4-440e-af83-c8278cab4bd9 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:51.041779 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-2b26b703-25e6-45f3-ba73-6bef437f8621 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:51.042159 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ec2675dc-ffb4-440e-af83-c8278cab4bd9 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:51.043103 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ec2675dc-ffb4-440e-af83-c8278cab4bd9 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:51.043616 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ec2675dc-ffb4-440e-af83-c8278cab4bd9 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:51.044044 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ec2675dc-ffb4-440e-af83-c8278cab4bd9 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:51.050357 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2b26b703-25e6-45f3-ba73-6bef437f8621 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:51.050745 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2b26b703-25e6-45f3-ba73-6bef437f8621 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:51.051185 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2b26b703-25e6-45f3-ba73-6bef437f8621 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:51.052468 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2b26b703-25e6-45f3-ba73-6bef437f8621 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:51.053090 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2b26b703-25e6-45f3-ba73-6bef437f8621 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:51.053515 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2b26b703-25e6-45f3-ba73-6bef437f8621 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:51.263107 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ec2675dc-ffb4-440e-af83-c8278cab4bd9 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:51.266568 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-2b26b703-25e6-45f3-ba73-6bef437f8621 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:51.275281 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ec2675dc-ffb4-440e-af83-c8278cab4bd9 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.247752 Aug 19 21:09:51.275876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 129/230] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:51 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:51.276351 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-2b26b703-25e6-45f3-ba73-6bef437f8621 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1554 microversion: 2.1 time: 0.242520 Aug 19 21:09:51.276909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 102/231] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:51 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1554 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:52.141383 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-adc6b47a-d9bf-4170-a40a-7778a48988c8 req-6ac6e6b9-7cbe-406f-9ea9-4771ae5cf611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4198f280-df5c-423d-9641-15abbd378905", "name": "network-vif-deleted", "tag": "f53aeb6e-aa9c-48b2-9f9c-ea05217129dc"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:09:52.154415 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-adc6b47a-d9bf-4170-a40a-7778a48988c8 req-6ac6e6b9-7cbe-406f-9ea9-4771ae5cf611 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:52.154901 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-adc6b47a-d9bf-4170-a40a-7778a48988c8 req-6ac6e6b9-7cbe-406f-9ea9-4771ae5cf611 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:52.155331 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-adc6b47a-d9bf-4170-a40a-7778a48988c8 req-6ac6e6b9-7cbe-406f-9ea9-4771ae5cf611 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:52.178378 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-adc6b47a-d9bf-4170-a40a-7778a48988c8 req-6ac6e6b9-7cbe-406f-9ea9-4771ae5cf611 service nova] Creating event network-vif-deleted:f53aeb6e-aa9c-48b2-9f9c-ea05217129dc for instance 4198f280-df5c-423d-9641-15abbd378905 on hv-cinder-85220 Aug 19 21:09:52.188642 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-adc6b47a-d9bf-4170-a40a-7778a48988c8 req-6ac6e6b9-7cbe-406f-9ea9-4771ae5cf611 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051393 Aug 19 21:09:52.193974 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 130/232] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:09:52.298526 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-e9a3a2bc-19d2-4684-aac9-edefe7ccc9bd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:52.299932 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-e9a3a2bc-19d2-4684-aac9-edefe7ccc9bd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:52.300376 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8659d1bf-a08e-4460-ba57-df77d49ed7d9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:52.301222 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8659d1bf-a08e-4460-ba57-df77d49ed7d9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:52.307861 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8659d1bf-a08e-4460-ba57-df77d49ed7d9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:52.308223 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e9a3a2bc-19d2-4684-aac9-edefe7ccc9bd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:52.308515 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8659d1bf-a08e-4460-ba57-df77d49ed7d9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:52.308747 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e9a3a2bc-19d2-4684-aac9-edefe7ccc9bd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:52.309451 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8659d1bf-a08e-4460-ba57-df77d49ed7d9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:52.309568 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e9a3a2bc-19d2-4684-aac9-edefe7ccc9bd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:52.309857 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8659d1bf-a08e-4460-ba57-df77d49ed7d9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:52.310089 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e9a3a2bc-19d2-4684-aac9-edefe7ccc9bd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:52.310489 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8659d1bf-a08e-4460-ba57-df77d49ed7d9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:52.310587 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e9a3a2bc-19d2-4684-aac9-edefe7ccc9bd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:52.310727 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8659d1bf-a08e-4460-ba57-df77d49ed7d9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:52.310947 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e9a3a2bc-19d2-4684-aac9-edefe7ccc9bd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:52.416771 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8659d1bf-a08e-4460-ba57-df77d49ed7d9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:52.425132 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8659d1bf-a08e-4460-ba57-df77d49ed7d9 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1346 microversion: 2.1 time: 0.130383 Aug 19 21:09:52.425708 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 131/233] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:52 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1346 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:52.486142 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-e9a3a2bc-19d2-4684-aac9-edefe7ccc9bd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:52.495596 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-e9a3a2bc-19d2-4684-aac9-edefe7ccc9bd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.201792 Aug 19 21:09:52.496176 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 103/234] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:52 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:53.448592 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8c55bdc2-11e6-4ed7-a162-c05f18257a8f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:53.450222 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8c55bdc2-11e6-4ed7-a162-c05f18257a8f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:53.457445 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c55bdc2-11e6-4ed7-a162-c05f18257a8f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:53.458582 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c55bdc2-11e6-4ed7-a162-c05f18257a8f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:53.459027 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c55bdc2-11e6-4ed7-a162-c05f18257a8f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:53.459901 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c55bdc2-11e6-4ed7-a162-c05f18257a8f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:53.460364 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c55bdc2-11e6-4ed7-a162-c05f18257a8f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:53.460790 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c55bdc2-11e6-4ed7-a162-c05f18257a8f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:53.519447 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-0ffbc180-f9fb-45fe-9dc0-3a4ac74a728b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:53.522073 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-0ffbc180-f9fb-45fe-9dc0-3a4ac74a728b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:53.537338 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0ffbc180-f9fb-45fe-9dc0-3a4ac74a728b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:53.538177 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0ffbc180-f9fb-45fe-9dc0-3a4ac74a728b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:53.538772 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0ffbc180-f9fb-45fe-9dc0-3a4ac74a728b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:53.539603 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0ffbc180-f9fb-45fe-9dc0-3a4ac74a728b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:53.539711 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8c55bdc2-11e6-4ed7-a162-c05f18257a8f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593a0461ca714cff98ae43eb8833197c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0321d32b9014fc0ae63387d3a5032e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:53.540205 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0ffbc180-f9fb-45fe-9dc0-3a4ac74a728b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:53.540762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0ffbc180-f9fb-45fe-9dc0-3a4ac74a728b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:53.542474 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=100 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:09:53.553976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8c55bdc2-11e6-4ed7-a162-c05f18257a8f tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 200 len: 1346 microversion: 2.1 time: 0.110521 Aug 19 21:09:53.560566 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 132/235] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:53 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 1346 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:53.711509 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-0ffbc180-f9fb-45fe-9dc0-3a4ac74a728b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:53.720899 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-0ffbc180-f9fb-45fe-9dc0-3a4ac74a728b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.206820 Aug 19 21:09:53.721659 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 104/236] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:53 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:54.575509 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-9c96aedf-58f3-41c2-886e-b067d6b7bb74 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:54.576224 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-9c96aedf-58f3-41c2-886e-b067d6b7bb74 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:54.582324 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9c96aedf-58f3-41c2-886e-b067d6b7bb74 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:54.582917 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9c96aedf-58f3-41c2-886e-b067d6b7bb74 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:54.583455 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9c96aedf-58f3-41c2-886e-b067d6b7bb74 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:54.584207 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9c96aedf-58f3-41c2-886e-b067d6b7bb74 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:54.584634 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9c96aedf-58f3-41c2-886e-b067d6b7bb74 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:54.585244 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9c96aedf-58f3-41c2-886e-b067d6b7bb74 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:54.602989 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-9c96aedf-58f3-41c2-886e-b067d6b7bb74 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] HTTP exception thrown: Instance 4198f280-df5c-423d-9641-15abbd378905 could not be found. Aug 19 21:09:54.607729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-9c96aedf-58f3-41c2-886e-b067d6b7bb74 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Request method failure captured: Aug 19 21:09:54.607729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 HTTP/1.1 Aug 19 21:09:54.607729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:09:54.607729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:09:54.607729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:09:54.607729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:09:54.607729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:09:54.607729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:09:54.607729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:09:54.607729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:09:54.607729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__vJbt6FhgZA2F3EP_K4sKov8haoohVi0npkrvnnSTZw7nf16bD_6WQlXjSsT78r1cIG3gyBr5p3ulf-oQtelc_WEoWAk5vSBNrfn7Zv6Le9_Y3rB71bxNtNW1A4L8P58X8y1WPvzXwEKSfZFWqTulQ8Mwyeew6igRGEzzgP9csrye8 Aug 19 21:09:54.607729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:09:54.607729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:09:54.607729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:09:54.607729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:09:54.607729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:09:54.607729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:09:54.607729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: c0321d32b9014fc0ae63387d3a5032e8 Aug 19 21:09:54.607729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-DeleteServersTestJSON-1870149891 Aug 19 21:09:54.607729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:09:54.607729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:09:54.609118 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c0321d32b9014fc0ae63387d3a5032e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c0321d32b9014fc0ae63387d3a5032e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c0321d32b9014fc0ae63387d3a5032e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c0321d32b9014fc0ae63387d3a5032e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:09:54.609118 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-DeleteServersTestJSON-1870149891 Aug 19 21:09:54.609118 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: c0321d32b9014fc0ae63387d3a5032e8 Aug 19 21:09:54.609118 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-DeleteServersTestJSON-1870149891 Aug 19 21:09:54.609118 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-DeleteServersTestJSON-1870149891-project Aug 19 21:09:54.609118 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:09:54.609118 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:09:54.609118 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: 593a0461ca714cff98ae43eb8833197c Aug 19 21:09:54.609118 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-DeleteServersTestJSON-1870149891-project Aug 19 21:09:54.609118 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: > Aug 19 21:09:54.609118 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Instance 4198f280-df5c-423d-9641-15abbd378905 could not be found. Aug 19 21:09:54.609118 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'id': '4198f280-df5c-423d-9641-15abbd378905'} Aug 19 21:09:54.610114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:09:54.610114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:09:54.610114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:09:54.610114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:09:54.610114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:09:54.610114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:09:54.610114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:09:54.610114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:09:54.610114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:09:54.610114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:09:54.610114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4198f280-df5c-423d-9641-15abbd378905 could not be found. Aug 19 21:09:54.610114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:09:54.610114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:09:54.610114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:09:54.610114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:09:54.610114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:09:54.610114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:09:54.610114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:09:54.610114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:09:54.610114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:09:54.611976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:09:54.611976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:09:54.611976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:09:54.611976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:09:54.611976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:09:54.611976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:09:54.611976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:09:54.611976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4198f280-df5c-423d-9641-15abbd378905 could not be found. Aug 19 21:09:54.611976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:09:54.611976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:09:54.611976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:09:54.611976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:09:54.611976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:09:54.611976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:09:54.611976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:09:54.611976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:09:54.611976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4198f280-df5c-423d-9641-15abbd378905 could not be found. Aug 19 21:09:54.611976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:09:54.613174 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-9c96aedf-58f3-41c2-886e-b067d6b7bb74 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Returning 404 to user: Instance 4198f280-df5c-423d-9641-15abbd378905 could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:09:54.613174 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-9c96aedf-58f3-41c2-886e-b067d6b7bb74 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 404 len: 111 microversion: 2.1 time: 0.038355 Aug 19 21:09:54.613174 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 133/237] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:54 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:09:54.735024 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-3aa3060c-00ec-45e6-8fd7-a0260dfe2c2e tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:54.737372 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-3aa3060c-00ec-45e6-8fd7-a0260dfe2c2e tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:54.743044 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-befa9817-e50b-4a97-9aaf-13b1b5510088 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:54.743980 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-befa9817-e50b-4a97-9aaf-13b1b5510088 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:54.745167 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3aa3060c-00ec-45e6-8fd7-a0260dfe2c2e tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:54.745791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3aa3060c-00ec-45e6-8fd7-a0260dfe2c2e tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:54.746126 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3aa3060c-00ec-45e6-8fd7-a0260dfe2c2e tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:54.746821 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3aa3060c-00ec-45e6-8fd7-a0260dfe2c2e tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:54.747275 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3aa3060c-00ec-45e6-8fd7-a0260dfe2c2e tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:54.747691 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3aa3060c-00ec-45e6-8fd7-a0260dfe2c2e tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:54.750675 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-befa9817-e50b-4a97-9aaf-13b1b5510088 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:54.751275 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-befa9817-e50b-4a97-9aaf-13b1b5510088 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:54.751946 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-befa9817-e50b-4a97-9aaf-13b1b5510088 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:54.753050 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-befa9817-e50b-4a97-9aaf-13b1b5510088 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:54.753740 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-befa9817-e50b-4a97-9aaf-13b1b5510088 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:54.754252 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-befa9817-e50b-4a97-9aaf-13b1b5510088 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:54.771208 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-3aa3060c-00ec-45e6-8fd7-a0260dfe2c2e tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] HTTP exception thrown: Instance 4198f280-df5c-423d-9641-15abbd378905 could not be found. Aug 19 21:09:54.777639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-3aa3060c-00ec-45e6-8fd7-a0260dfe2c2e tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Request method failure captured: Aug 19 21:09:54.777639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905/os-volume_attachments HTTP/1.1 Aug 19 21:09:54.777639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:09:54.777639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:09:54.777639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:09:54.777639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:09:54.777639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:09:54.777639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:09:54.777639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:09:54.777639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:09:54.777639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__vJbt6FhgZA2F3EP_K4sKov8haoohVi0npkrvnnSTZw7nf16bD_6WQlXjSsT78r1cIG3gyBr5p3ulf-oQtelc_WEoWAk5vSBNrfn7Zv6Le9_Y3rB71bxNtNW1A4L8P58X8y1WPvzXwEKSfZFWqTulQ8Mwyeew6igRGEzzgP9csrye8 Aug 19 21:09:54.777639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:09:54.777639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:09:54.777639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:09:54.777639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:09:54.777639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:09:54.777639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:09:54.777639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: c0321d32b9014fc0ae63387d3a5032e8 Aug 19 21:09:54.777639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-DeleteServersTestJSON-1870149891 Aug 19 21:09:54.777639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:09:54.777639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:09:54.779608 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c0321d32b9014fc0ae63387d3a5032e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c0321d32b9014fc0ae63387d3a5032e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c0321d32b9014fc0ae63387d3a5032e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c0321d32b9014fc0ae63387d3a5032e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:09:54.779608 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-DeleteServersTestJSON-1870149891 Aug 19 21:09:54.779608 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: c0321d32b9014fc0ae63387d3a5032e8 Aug 19 21:09:54.779608 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-DeleteServersTestJSON-1870149891 Aug 19 21:09:54.779608 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-DeleteServersTestJSON-1870149891-project Aug 19 21:09:54.779608 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:09:54.779608 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:09:54.779608 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: 593a0461ca714cff98ae43eb8833197c Aug 19 21:09:54.779608 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-DeleteServersTestJSON-1870149891-project Aug 19 21:09:54.779608 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: > Aug 19 21:09:54.779608 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Instance 4198f280-df5c-423d-9641-15abbd378905 could not be found. Aug 19 21:09:54.779608 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'server_id': '4198f280-df5c-423d-9641-15abbd378905'} Aug 19 21:09:54.780380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:09:54.780380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:09:54.780380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:09:54.780380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:09:54.780380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:09:54.780380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:09:54.780380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:09:54.780380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:09:54.780380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:09:54.780380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:09:54.780380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4198f280-df5c-423d-9641-15abbd378905 could not be found. Aug 19 21:09:54.780380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:09:54.780380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:09:54.780380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:09:54.780380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:09:54.780380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:09:54.780380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:09:54.780380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:09:54.780380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:09:54.780380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:09:54.781634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:09:54.781634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 19 21:09:54.781634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 21:09:54.781634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 19 21:09:54.781634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 21:09:54.781634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 19 21:09:54.781634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 19 21:09:54.781634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:09:54.781634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:09:54.781634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4198f280-df5c-423d-9641-15abbd378905 could not be found. Aug 19 21:09:54.781634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:09:54.781634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:09:54.781634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:09:54.781634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:09:54.781634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:09:54.781634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:09:54.781634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:09:54.781634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:09:54.781634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4198f280-df5c-423d-9641-15abbd378905 could not be found. Aug 19 21:09:54.781634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:09:54.782862 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-3aa3060c-00ec-45e6-8fd7-a0260dfe2c2e tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Returning 404 to user: Instance 4198f280-df5c-423d-9641-15abbd378905 could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:09:54.783792 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-3aa3060c-00ec-45e6-8fd7-a0260dfe2c2e tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.052910 Aug 19 21:09:54.784624 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 105/238] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Aug 19 21:09:54 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905/os-volume_attachments => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:09:54.934678 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-befa9817-e50b-4a97-9aaf-13b1b5510088 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:54.954463 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-befa9817-e50b-4a97-9aaf-13b1b5510088 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.215271 Aug 19 21:09:54.955197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 134/239] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:54 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:09:55.988796 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-8ecf0347-0021-407f-b890-4c8ee33f6f2d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:55.990015 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-8ecf0347-0021-407f-b890-4c8ee33f6f2d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:55.998027 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8ecf0347-0021-407f-b890-4c8ee33f6f2d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:55.998512 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8ecf0347-0021-407f-b890-4c8ee33f6f2d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:55.999758 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8ecf0347-0021-407f-b890-4c8ee33f6f2d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:55.999758 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8ecf0347-0021-407f-b890-4c8ee33f6f2d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:56.000831 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8ecf0347-0021-407f-b890-4c8ee33f6f2d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:56.000831 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8ecf0347-0021-407f-b890-4c8ee33f6f2d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:56.107411 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-da2f11bb-6681-4672-9481-33b49da05b28 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:56.107935 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-da2f11bb-6681-4672-9481-33b49da05b28 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:56.115766 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-da2f11bb-6681-4672-9481-33b49da05b28 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:56.116598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-da2f11bb-6681-4672-9481-33b49da05b28 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:56.117042 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-da2f11bb-6681-4672-9481-33b49da05b28 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:56.117933 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-da2f11bb-6681-4672-9481-33b49da05b28 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:56.118351 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-da2f11bb-6681-4672-9481-33b49da05b28 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:56.118858 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-da2f11bb-6681-4672-9481-33b49da05b28 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:56.134376 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-da2f11bb-6681-4672-9481-33b49da05b28 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] HTTP exception thrown: Instance 4198f280-df5c-423d-9641-15abbd378905 could not be found. Aug 19 21:09:56.136099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-da2f11bb-6681-4672-9481-33b49da05b28 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Request method failure captured: Aug 19 21:09:56.136099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: DELETE /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 HTTP/1.1 Aug 19 21:09:56.136099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:09:56.136099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:09:56.136099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:09:56.136099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:09:56.136099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:09:56.136099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:09:56.136099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:09:56.136099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:09:56.136099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__vJbt6FhgZA2F3EP_K4sKov8haoohVi0npkrvnnSTZw7nf16bD_6WQlXjSsT78r1cIG3gyBr5p3ulf-oQtelc_WEoWAk5vSBNrfn7Zv6Le9_Y3rB71bxNtNW1A4L8P58X8y1WPvzXwEKSfZFWqTulQ8Mwyeew6igRGEzzgP9csrye8 Aug 19 21:09:56.136099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:09:56.136099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:09:56.136099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:09:56.136099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:09:56.136099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:09:56.136099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:09:56.136099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: c0321d32b9014fc0ae63387d3a5032e8 Aug 19 21:09:56.136099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-DeleteServersTestJSON-1870149891 Aug 19 21:09:56.136099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:09:56.136099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:09:56.137647 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c0321d32b9014fc0ae63387d3a5032e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c0321d32b9014fc0ae63387d3a5032e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c0321d32b9014fc0ae63387d3a5032e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c0321d32b9014fc0ae63387d3a5032e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:09:56.137647 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-DeleteServersTestJSON-1870149891 Aug 19 21:09:56.137647 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: c0321d32b9014fc0ae63387d3a5032e8 Aug 19 21:09:56.137647 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-DeleteServersTestJSON-1870149891 Aug 19 21:09:56.137647 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-DeleteServersTestJSON-1870149891-project Aug 19 21:09:56.137647 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:09:56.137647 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:09:56.137647 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: 593a0461ca714cff98ae43eb8833197c Aug 19 21:09:56.137647 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-DeleteServersTestJSON-1870149891-project Aug 19 21:09:56.137647 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: > Aug 19 21:09:56.137647 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Instance 4198f280-df5c-423d-9641-15abbd378905 could not be found. Aug 19 21:09:56.137647 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'id': '4198f280-df5c-423d-9641-15abbd378905'} Aug 19 21:09:56.138585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:09:56.138585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:09:56.138585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:09:56.138585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:09:56.138585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:09:56.138585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:09:56.138585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:09:56.138585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:09:56.138585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:09:56.138585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:09:56.138585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4198f280-df5c-423d-9641-15abbd378905 could not be found. Aug 19 21:09:56.138585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:09:56.138585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:09:56.138585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:09:56.138585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:09:56.138585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:09:56.138585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:09:56.138585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:09:56.138585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:09:56.138585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:09:56.139744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:09:56.139744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 21:09:56.139744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 21:09:56.139744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 21:09:56.139744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 21:09:56.139744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:09:56.139744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:09:56.139744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:09:56.139744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:09:56.139744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4198f280-df5c-423d-9641-15abbd378905 could not be found. Aug 19 21:09:56.139744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:09:56.139744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:09:56.139744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:09:56.139744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:09:56.139744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:09:56.139744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:09:56.139744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:09:56.139744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:09:56.139744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4198f280-df5c-423d-9641-15abbd378905 could not be found. Aug 19 21:09:56.139744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:09:56.141219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-da2f11bb-6681-4672-9481-33b49da05b28 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Returning 404 to user: Instance 4198f280-df5c-423d-9641-15abbd378905 could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:09:56.141219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-da2f11bb-6681-4672-9481-33b49da05b28 tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 404 len: 111 microversion: 2.1 time: 0.033951 Aug 19 21:09:56.141382 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 135/240] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:09:56 2022] DELETE /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 19 21:09:56.146894 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3fa0f3a8-c6bd-4e0c-8912-1fb1be2ee45c tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:56.147513 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-3fa0f3a8-c6bd-4e0c-8912-1fb1be2ee45c tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] [instance: 4198f280-df5c-423d-9641-15abbd378905] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:56.153660 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3fa0f3a8-c6bd-4e0c-8912-1fb1be2ee45c tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:56.154175 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3fa0f3a8-c6bd-4e0c-8912-1fb1be2ee45c tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:56.154604 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3fa0f3a8-c6bd-4e0c-8912-1fb1be2ee45c tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:56.155291 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3fa0f3a8-c6bd-4e0c-8912-1fb1be2ee45c tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:56.155764 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3fa0f3a8-c6bd-4e0c-8912-1fb1be2ee45c tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:56.156134 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3fa0f3a8-c6bd-4e0c-8912-1fb1be2ee45c tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:56.158652 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-8ecf0347-0021-407f-b890-4c8ee33f6f2d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:56.167345 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-8ecf0347-0021-407f-b890-4c8ee33f6f2d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.183132 Aug 19 21:09:56.167926 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 106/241] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:55 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:56.170905 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-3fa0f3a8-c6bd-4e0c-8912-1fb1be2ee45c tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] HTTP exception thrown: Instance 4198f280-df5c-423d-9641-15abbd378905 could not be found. Aug 19 21:09:56.172422 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3fa0f3a8-c6bd-4e0c-8912-1fb1be2ee45c tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Request method failure captured: Aug 19 21:09:56.172422 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 HTTP/1.1 Aug 19 21:09:56.172422 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:09:56.172422 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:09:56.172422 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:09:56.172422 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:09:56.172422 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:09:56.172422 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:09:56.172422 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:09:56.172422 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:09:56.172422 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__vJbt6FhgZA2F3EP_K4sKov8haoohVi0npkrvnnSTZw7nf16bD_6WQlXjSsT78r1cIG3gyBr5p3ulf-oQtelc_WEoWAk5vSBNrfn7Zv6Le9_Y3rB71bxNtNW1A4L8P58X8y1WPvzXwEKSfZFWqTulQ8Mwyeew6igRGEzzgP9csrye8 Aug 19 21:09:56.172422 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:09:56.172422 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:09:56.172422 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:09:56.172422 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:09:56.172422 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:09:56.172422 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:09:56.172422 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: c0321d32b9014fc0ae63387d3a5032e8 Aug 19 21:09:56.172422 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-DeleteServersTestJSON-1870149891 Aug 19 21:09:56.172422 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:09:56.172422 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:09:56.174586 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c0321d32b9014fc0ae63387d3a5032e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c0321d32b9014fc0ae63387d3a5032e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c0321d32b9014fc0ae63387d3a5032e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c0321d32b9014fc0ae63387d3a5032e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:09:56.174586 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-DeleteServersTestJSON-1870149891 Aug 19 21:09:56.174586 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: c0321d32b9014fc0ae63387d3a5032e8 Aug 19 21:09:56.174586 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-DeleteServersTestJSON-1870149891 Aug 19 21:09:56.174586 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-DeleteServersTestJSON-1870149891-project Aug 19 21:09:56.174586 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:09:56.174586 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:09:56.174586 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: 593a0461ca714cff98ae43eb8833197c Aug 19 21:09:56.174586 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-DeleteServersTestJSON-1870149891-project Aug 19 21:09:56.174586 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: > Aug 19 21:09:56.174586 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Instance 4198f280-df5c-423d-9641-15abbd378905 could not be found. Aug 19 21:09:56.174586 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'id': '4198f280-df5c-423d-9641-15abbd378905'} Aug 19 21:09:56.175585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:09:56.175585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:09:56.175585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:09:56.175585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:09:56.175585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:09:56.175585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:09:56.175585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:09:56.175585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:09:56.175585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:09:56.175585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:09:56.175585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4198f280-df5c-423d-9641-15abbd378905 could not be found. Aug 19 21:09:56.175585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:09:56.175585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:09:56.175585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:09:56.175585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:09:56.175585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:09:56.175585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:09:56.175585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:09:56.175585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:09:56.175585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:09:56.177572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:09:56.177572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:09:56.177572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:09:56.177572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:09:56.177572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:09:56.177572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:09:56.177572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:09:56.177572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4198f280-df5c-423d-9641-15abbd378905 could not be found. Aug 19 21:09:56.177572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:09:56.177572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:09:56.177572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:09:56.177572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:09:56.177572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:09:56.177572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:09:56.177572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:09:56.177572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:09:56.177572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4198f280-df5c-423d-9641-15abbd378905 could not be found. Aug 19 21:09:56.177572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:09:56.179568 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3fa0f3a8-c6bd-4e0c-8912-1fb1be2ee45c tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] Returning 404 to user: Instance 4198f280-df5c-423d-9641-15abbd378905 could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:09:56.179568 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-3fa0f3a8-c6bd-4e0c-8912-1fb1be2ee45c tempest-DeleteServersTestJSON-1870149891 tempest-DeleteServersTestJSON-1870149891-project] 10.222.0.16 "GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905" status: 404 len: 111 microversion: 2.1 time: 0.031523 Aug 19 21:09:56.179568 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 136/242] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:56 2022] GET /compute/v2.1/servers/4198f280-df5c-423d-9641-15abbd378905 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:09:57.192815 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-55674c53-4d9c-49a4-8b6b-0e5d22f4b214 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:57.193844 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-55674c53-4d9c-49a4-8b6b-0e5d22f4b214 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:57.201184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-55674c53-4d9c-49a4-8b6b-0e5d22f4b214 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:57.201900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-55674c53-4d9c-49a4-8b6b-0e5d22f4b214 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:57.202340 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-55674c53-4d9c-49a4-8b6b-0e5d22f4b214 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:57.203195 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-55674c53-4d9c-49a4-8b6b-0e5d22f4b214 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:57.203661 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-55674c53-4d9c-49a4-8b6b-0e5d22f4b214 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:57.204072 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-55674c53-4d9c-49a4-8b6b-0e5d22f4b214 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:57.483414 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-55674c53-4d9c-49a4-8b6b-0e5d22f4b214 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:57.493376 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-55674c53-4d9c-49a4-8b6b-0e5d22f4b214 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.305214 Aug 19 21:09:57.494107 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 107/243] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:57 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:58.517637 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-5aff1eb7-6193-47dd-8127-248ac337009c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:58.519714 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-5aff1eb7-6193-47dd-8127-248ac337009c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:58.532463 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5aff1eb7-6193-47dd-8127-248ac337009c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:58.533028 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5aff1eb7-6193-47dd-8127-248ac337009c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:58.533487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5aff1eb7-6193-47dd-8127-248ac337009c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:58.534488 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5aff1eb7-6193-47dd-8127-248ac337009c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:58.535422 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5aff1eb7-6193-47dd-8127-248ac337009c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:58.536726 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5aff1eb7-6193-47dd-8127-248ac337009c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:58.761870 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-5aff1eb7-6193-47dd-8127-248ac337009c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:09:58.781727 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-5aff1eb7-6193-47dd-8127-248ac337009c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.270073 Aug 19 21:09:58.785732 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 137/244] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:58 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:09:59.809735 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-b3365776-867a-4bc8-9c9d-9a2f1ed52c1b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:09:59.810639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-b3365776-867a-4bc8-9c9d-9a2f1ed52c1b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:09:59.818580 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3365776-867a-4bc8-9c9d-9a2f1ed52c1b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:59.819369 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3365776-867a-4bc8-9c9d-9a2f1ed52c1b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:59.819908 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3365776-867a-4bc8-9c9d-9a2f1ed52c1b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:09:59.820931 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3365776-867a-4bc8-9c9d-9a2f1ed52c1b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:09:59.821537 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3365776-867a-4bc8-9c9d-9a2f1ed52c1b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:09:59.822131 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3365776-867a-4bc8-9c9d-9a2f1ed52c1b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:00.075214 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b3365776-867a-4bc8-9c9d-9a2f1ed52c1b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:00.111414 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-b3365776-867a-4bc8-9c9d-9a2f1ed52c1b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.305264 Aug 19 21:10:00.113516 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 108/245] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:09:59 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:01.143819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8c1b9fff-15a5-485c-9eef-3daa125470e9 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:01.144467 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8c1b9fff-15a5-485c-9eef-3daa125470e9 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:01.152765 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c1b9fff-15a5-485c-9eef-3daa125470e9 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:01.153446 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c1b9fff-15a5-485c-9eef-3daa125470e9 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:01.153936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c1b9fff-15a5-485c-9eef-3daa125470e9 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:01.154828 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c1b9fff-15a5-485c-9eef-3daa125470e9 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:01.155834 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c1b9fff-15a5-485c-9eef-3daa125470e9 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:01.156466 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c1b9fff-15a5-485c-9eef-3daa125470e9 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:01.350101 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8c1b9fff-15a5-485c-9eef-3daa125470e9 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:01.365832 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8c1b9fff-15a5-485c-9eef-3daa125470e9 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.233854 Aug 19 21:10:01.367362 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 138/246] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:01 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:02.401982 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-b331ef3d-20f7-45b6-8a9c-1b9309529dee tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:02.403763 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-b331ef3d-20f7-45b6-8a9c-1b9309529dee tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:02.413672 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b331ef3d-20f7-45b6-8a9c-1b9309529dee tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:02.414410 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b331ef3d-20f7-45b6-8a9c-1b9309529dee tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:02.415095 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b331ef3d-20f7-45b6-8a9c-1b9309529dee tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:02.415995 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b331ef3d-20f7-45b6-8a9c-1b9309529dee tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:02.416610 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b331ef3d-20f7-45b6-8a9c-1b9309529dee tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:02.417524 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b331ef3d-20f7-45b6-8a9c-1b9309529dee tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:02.450310 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:02.595704 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b331ef3d-20f7-45b6-8a9c-1b9309529dee tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:02.607225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-b331ef3d-20f7-45b6-8a9c-1b9309529dee tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.210325 Aug 19 21:10:02.608145 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 109/247] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:02 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:03.634205 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-b5f1ad23-6bb2-464b-8a69-1fa542c90589 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:03.635705 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-b5f1ad23-6bb2-464b-8a69-1fa542c90589 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:03.642790 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b5f1ad23-6bb2-464b-8a69-1fa542c90589 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:03.644172 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b5f1ad23-6bb2-464b-8a69-1fa542c90589 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:03.645444 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b5f1ad23-6bb2-464b-8a69-1fa542c90589 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:03.646395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b5f1ad23-6bb2-464b-8a69-1fa542c90589 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:03.646957 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b5f1ad23-6bb2-464b-8a69-1fa542c90589 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:03.647474 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b5f1ad23-6bb2-464b-8a69-1fa542c90589 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:03.821116 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-b5f1ad23-6bb2-464b-8a69-1fa542c90589 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:03.830695 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-b5f1ad23-6bb2-464b-8a69-1fa542c90589 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.203200 Aug 19 21:10:03.831297 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 139/248] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:03 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:10:04.860291 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-516ef87c-4e35-4889-8af2-63e3f20b6d63 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:04.860989 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-516ef87c-4e35-4889-8af2-63e3f20b6d63 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:04.871801 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-516ef87c-4e35-4889-8af2-63e3f20b6d63 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:04.872306 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-516ef87c-4e35-4889-8af2-63e3f20b6d63 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:04.872751 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-516ef87c-4e35-4889-8af2-63e3f20b6d63 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:04.873509 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-516ef87c-4e35-4889-8af2-63e3f20b6d63 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:04.874175 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-516ef87c-4e35-4889-8af2-63e3f20b6d63 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:04.874973 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-516ef87c-4e35-4889-8af2-63e3f20b6d63 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:05.057208 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-516ef87c-4e35-4889-8af2-63e3f20b6d63 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:05.065202 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-516ef87c-4e35-4889-8af2-63e3f20b6d63 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.209857 Aug 19 21:10:05.079202 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 110/249] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:04 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:06.088704 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-bb6f3515-5126-4dd8-938a-18aaae66338f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:06.089315 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-bb6f3515-5126-4dd8-938a-18aaae66338f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:06.093913 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=54 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:06.100242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bb6f3515-5126-4dd8-938a-18aaae66338f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:06.100741 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bb6f3515-5126-4dd8-938a-18aaae66338f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:06.101372 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bb6f3515-5126-4dd8-938a-18aaae66338f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:06.102144 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bb6f3515-5126-4dd8-938a-18aaae66338f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:06.102607 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bb6f3515-5126-4dd8-938a-18aaae66338f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:06.103031 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bb6f3515-5126-4dd8-938a-18aaae66338f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:06.266565 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-bb6f3515-5126-4dd8-938a-18aaae66338f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:06.275434 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-bb6f3515-5126-4dd8-938a-18aaae66338f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1521 microversion: 2.1 time: 0.191029 Aug 19 21:10:06.276027 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 140/250] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:06 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:10:07.298511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-ebe66bad-6c42-4017-96cb-88db6a4d0fa1 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:07.299151 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-ebe66bad-6c42-4017-96cb-88db6a4d0fa1 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:07.307235 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ebe66bad-6c42-4017-96cb-88db6a4d0fa1 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:07.307728 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ebe66bad-6c42-4017-96cb-88db6a4d0fa1 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:07.308157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ebe66bad-6c42-4017-96cb-88db6a4d0fa1 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:07.308862 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ebe66bad-6c42-4017-96cb-88db6a4d0fa1 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:07.309318 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ebe66bad-6c42-4017-96cb-88db6a4d0fa1 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:07.309740 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ebe66bad-6c42-4017-96cb-88db6a4d0fa1 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:07.495817 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-ebe66bad-6c42-4017-96cb-88db6a4d0fa1 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:07.504058 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-ebe66bad-6c42-4017-96cb-88db6a4d0fa1 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1501 microversion: 2.1 time: 0.209518 Aug 19 21:10:07.504718 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 111/251] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:07 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1501 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:07.530450 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-7d6516ea-cf07-4404-8278-ab7f4d84fb6c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:07.540175 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-7d6516ea-cf07-4404-8278-ab7f4d84fb6c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:07.546491 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7d6516ea-cf07-4404-8278-ab7f4d84fb6c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:07.547217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7d6516ea-cf07-4404-8278-ab7f4d84fb6c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:07.547814 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7d6516ea-cf07-4404-8278-ab7f4d84fb6c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:07.548514 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7d6516ea-cf07-4404-8278-ab7f4d84fb6c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:07.549366 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7d6516ea-cf07-4404-8278-ab7f4d84fb6c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:07.549366 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7d6516ea-cf07-4404-8278-ab7f4d84fb6c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:07.828024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-7d6516ea-cf07-4404-8278-ab7f4d84fb6c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:07.840039 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-7d6516ea-cf07-4404-8278-ab7f4d84fb6c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1514 microversion: 2.1 time: 0.313332 Aug 19 21:10:07.840868 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 141/252] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:07 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1514 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:16.013799 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-58e197f4-ec13-4ea9-a055-e6798744f879 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:10:16.017674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-58e197f4-ec13-4ea9-a055-e6798744f879 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:16.029877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-58e197f4-ec13-4ea9-a055-e6798744f879 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:16.030615 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-58e197f4-ec13-4ea9-a055-e6798744f879 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:16.031449 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-58e197f4-ec13-4ea9-a055-e6798744f879 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:16.032506 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-58e197f4-ec13-4ea9-a055-e6798744f879 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:16.033187 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-58e197f4-ec13-4ea9-a055-e6798744f879 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:16.033699 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-58e197f4-ec13-4ea9-a055-e6798744f879 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:16.060979 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.objects.instance [None req-58e197f4-ec13-4ea9-a055-e6798744f879 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lazy-loading 'flavor' on Instance uuid e363b06b-e5dd-48c8-a0d8-afdfa5bad759 {{(pid=120876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:10:16.156731 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-58e197f4-ec13-4ea9-a055-e6798744f879 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "POST /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759/action" status: 200 len: 32 microversion: 2.1 time: 0.150956 Aug 19 21:10:16.157370 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 112/253] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Aug 19 21:10:16 2022] POST /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759/action => generated 32 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 19 21:10:16.168528 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0d99cfcc-84f3-45ce-a8d1-65e5eddf4e23 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:16.169816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0d99cfcc-84f3-45ce-a8d1-65e5eddf4e23 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:16.178484 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0d99cfcc-84f3-45ce-a8d1-65e5eddf4e23 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:16.179436 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0d99cfcc-84f3-45ce-a8d1-65e5eddf4e23 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:16.180314 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0d99cfcc-84f3-45ce-a8d1-65e5eddf4e23 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:16.182051 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0d99cfcc-84f3-45ce-a8d1-65e5eddf4e23 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:16.183516 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0d99cfcc-84f3-45ce-a8d1-65e5eddf4e23 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:16.184456 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0d99cfcc-84f3-45ce-a8d1-65e5eddf4e23 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:16.381657 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0d99cfcc-84f3-45ce-a8d1-65e5eddf4e23 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:16.390194 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0d99cfcc-84f3-45ce-a8d1-65e5eddf4e23 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1520 microversion: 2.1 time: 0.225863 Aug 19 21:10:16.390783 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 142/254] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:16 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:17.426563 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-adc146ea-2cb7-4773-8d24-b8066e0d2409 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:17.428300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-adc146ea-2cb7-4773-8d24-b8066e0d2409 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:17.435414 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-adc146ea-2cb7-4773-8d24-b8066e0d2409 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:17.436000 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-adc146ea-2cb7-4773-8d24-b8066e0d2409 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:17.436483 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-adc146ea-2cb7-4773-8d24-b8066e0d2409 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:17.437255 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-adc146ea-2cb7-4773-8d24-b8066e0d2409 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:17.437712 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-adc146ea-2cb7-4773-8d24-b8066e0d2409 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:17.438211 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-adc146ea-2cb7-4773-8d24-b8066e0d2409 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:17.583477 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-adc146ea-2cb7-4773-8d24-b8066e0d2409 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:17.591399 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-adc146ea-2cb7-4773-8d24-b8066e0d2409 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1520 microversion: 2.1 time: 0.170566 Aug 19 21:10:17.591969 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 113/255] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:17 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:18.612754 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-f3c64b6d-3cfa-4163-b6dc-b7c627fca37b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:18.613330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-f3c64b6d-3cfa-4163-b6dc-b7c627fca37b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:18.619484 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f3c64b6d-3cfa-4163-b6dc-b7c627fca37b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:18.619961 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f3c64b6d-3cfa-4163-b6dc-b7c627fca37b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:18.620389 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f3c64b6d-3cfa-4163-b6dc-b7c627fca37b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:18.621068 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f3c64b6d-3cfa-4163-b6dc-b7c627fca37b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:18.621514 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f3c64b6d-3cfa-4163-b6dc-b7c627fca37b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:18.621961 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f3c64b6d-3cfa-4163-b6dc-b7c627fca37b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:18.753721 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-f3c64b6d-3cfa-4163-b6dc-b7c627fca37b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:18.762303 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-f3c64b6d-3cfa-4163-b6dc-b7c627fca37b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1520 microversion: 2.1 time: 0.153488 Aug 19 21:10:18.762868 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 143/256] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:18 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:19.782931 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-566b9ccd-9ca7-416b-8a10-5365fdb373d8 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:19.783531 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-566b9ccd-9ca7-416b-8a10-5365fdb373d8 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:19.786704 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:19.792928 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-566b9ccd-9ca7-416b-8a10-5365fdb373d8 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:19.793414 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-566b9ccd-9ca7-416b-8a10-5365fdb373d8 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:19.793879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-566b9ccd-9ca7-416b-8a10-5365fdb373d8 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:19.794571 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-566b9ccd-9ca7-416b-8a10-5365fdb373d8 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:19.795016 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-566b9ccd-9ca7-416b-8a10-5365fdb373d8 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:19.795432 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-566b9ccd-9ca7-416b-8a10-5365fdb373d8 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:19.955189 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-566b9ccd-9ca7-416b-8a10-5365fdb373d8 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:19.963849 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-566b9ccd-9ca7-416b-8a10-5365fdb373d8 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1520 microversion: 2.1 time: 0.184760 Aug 19 21:10:19.964411 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 114/257] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:19 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:20.986414 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-9a79e436-94ee-413a-b7cc-18d45f3fd342 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:20.987335 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-9a79e436-94ee-413a-b7cc-18d45f3fd342 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:20.994003 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9a79e436-94ee-413a-b7cc-18d45f3fd342 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:20.994499 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9a79e436-94ee-413a-b7cc-18d45f3fd342 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:20.994942 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9a79e436-94ee-413a-b7cc-18d45f3fd342 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:20.995654 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9a79e436-94ee-413a-b7cc-18d45f3fd342 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:20.996104 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9a79e436-94ee-413a-b7cc-18d45f3fd342 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:20.996528 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9a79e436-94ee-413a-b7cc-18d45f3fd342 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:21.151183 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-9a79e436-94ee-413a-b7cc-18d45f3fd342 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:21.159405 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-9a79e436-94ee-413a-b7cc-18d45f3fd342 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1520 microversion: 2.1 time: 0.176855 Aug 19 21:10:21.160008 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 144/258] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:20 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:22.183980 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-6176ca93-4427-4d49-a3fd-7add4144af15 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:22.184797 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-6176ca93-4427-4d49-a3fd-7add4144af15 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:22.191850 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6176ca93-4427-4d49-a3fd-7add4144af15 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:22.192352 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6176ca93-4427-4d49-a3fd-7add4144af15 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:22.192870 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6176ca93-4427-4d49-a3fd-7add4144af15 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:22.193641 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6176ca93-4427-4d49-a3fd-7add4144af15 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:22.194263 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6176ca93-4427-4d49-a3fd-7add4144af15 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:22.194722 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6176ca93-4427-4d49-a3fd-7add4144af15 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:22.369413 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-6176ca93-4427-4d49-a3fd-7add4144af15 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:22.377324 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-6176ca93-4427-4d49-a3fd-7add4144af15 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1520 microversion: 2.1 time: 0.197328 Aug 19 21:10:22.377920 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 115/259] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:22 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:23.401932 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8fb64b30-dee6-41b0-8a99-c4042761e876 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:23.402535 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8fb64b30-dee6-41b0-8a99-c4042761e876 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:23.409125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8fb64b30-dee6-41b0-8a99-c4042761e876 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:23.409618 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8fb64b30-dee6-41b0-8a99-c4042761e876 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:23.410085 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8fb64b30-dee6-41b0-8a99-c4042761e876 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:23.411792 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8fb64b30-dee6-41b0-8a99-c4042761e876 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:23.412287 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8fb64b30-dee6-41b0-8a99-c4042761e876 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:23.412711 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8fb64b30-dee6-41b0-8a99-c4042761e876 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:23.560380 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8fb64b30-dee6-41b0-8a99-c4042761e876 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:23.562663 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=66 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:23.569811 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8fb64b30-dee6-41b0-8a99-c4042761e876 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1520 microversion: 2.1 time: 0.171865 Aug 19 21:10:23.570391 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 145/260] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:23 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:24.592545 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-c25cbed5-5718-4156-8590-230136173c75 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:24.593070 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-c25cbed5-5718-4156-8590-230136173c75 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:24.599847 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c25cbed5-5718-4156-8590-230136173c75 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:24.600339 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c25cbed5-5718-4156-8590-230136173c75 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:24.600771 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c25cbed5-5718-4156-8590-230136173c75 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:24.601477 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c25cbed5-5718-4156-8590-230136173c75 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:24.601972 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c25cbed5-5718-4156-8590-230136173c75 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:24.602395 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c25cbed5-5718-4156-8590-230136173c75 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:24.747680 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-c25cbed5-5718-4156-8590-230136173c75 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:24.757379 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-c25cbed5-5718-4156-8590-230136173c75 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1520 microversion: 2.1 time: 0.169039 Aug 19 21:10:24.758208 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 116/261] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:24 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:25.779421 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-74740e0c-4c58-40c1-a1c8-044eaa82704d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:25.780150 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-74740e0c-4c58-40c1-a1c8-044eaa82704d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:25.786970 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-74740e0c-4c58-40c1-a1c8-044eaa82704d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:25.787458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-74740e0c-4c58-40c1-a1c8-044eaa82704d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:25.787894 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-74740e0c-4c58-40c1-a1c8-044eaa82704d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:25.788593 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-74740e0c-4c58-40c1-a1c8-044eaa82704d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:25.789046 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-74740e0c-4c58-40c1-a1c8-044eaa82704d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:25.789467 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-74740e0c-4c58-40c1-a1c8-044eaa82704d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:25.926813 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-74740e0c-4c58-40c1-a1c8-044eaa82704d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:25.936671 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-74740e0c-4c58-40c1-a1c8-044eaa82704d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1520 microversion: 2.1 time: 0.161020 Aug 19 21:10:25.937328 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 146/262] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:25 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:26.960666 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-7a296a3a-d229-43c1-b468-10a398c513a0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:26.961281 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-7a296a3a-d229-43c1-b468-10a398c513a0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:26.967907 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7a296a3a-d229-43c1-b468-10a398c513a0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:26.968387 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7a296a3a-d229-43c1-b468-10a398c513a0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:26.968817 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7a296a3a-d229-43c1-b468-10a398c513a0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:26.969500 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7a296a3a-d229-43c1-b468-10a398c513a0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:26.969985 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7a296a3a-d229-43c1-b468-10a398c513a0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:26.970403 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7a296a3a-d229-43c1-b468-10a398c513a0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:27.119489 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-7a296a3a-d229-43c1-b468-10a398c513a0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:27.127768 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-7a296a3a-d229-43c1-b468-10a398c513a0 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1520 microversion: 2.1 time: 0.171090 Aug 19 21:10:27.128616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 117/263] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:26 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:28.150343 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-eb99719d-3e86-4f76-946e-e5911b97b402 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:28.151014 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-eb99719d-3e86-4f76-946e-e5911b97b402 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:28.157099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eb99719d-3e86-4f76-946e-e5911b97b402 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:28.157585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eb99719d-3e86-4f76-946e-e5911b97b402 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:28.158072 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eb99719d-3e86-4f76-946e-e5911b97b402 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:28.159050 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eb99719d-3e86-4f76-946e-e5911b97b402 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:28.159503 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eb99719d-3e86-4f76-946e-e5911b97b402 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:28.159926 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eb99719d-3e86-4f76-946e-e5911b97b402 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:28.311932 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-eb99719d-3e86-4f76-946e-e5911b97b402 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:28.326892 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-eb99719d-3e86-4f76-946e-e5911b97b402 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1520 microversion: 2.1 time: 0.180094 Aug 19 21:10:28.327968 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 147/264] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:28 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:29.348554 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-408875fb-160f-4680-8dad-119794fc6b7c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:29.349169 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-408875fb-160f-4680-8dad-119794fc6b7c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:29.356083 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-408875fb-160f-4680-8dad-119794fc6b7c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:29.356673 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-408875fb-160f-4680-8dad-119794fc6b7c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:29.357288 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-408875fb-160f-4680-8dad-119794fc6b7c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:29.358115 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-408875fb-160f-4680-8dad-119794fc6b7c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:29.358653 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-408875fb-160f-4680-8dad-119794fc6b7c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:29.359156 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-408875fb-160f-4680-8dad-119794fc6b7c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:29.511700 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-408875fb-160f-4680-8dad-119794fc6b7c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:29.519776 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-408875fb-160f-4680-8dad-119794fc6b7c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1520 microversion: 2.1 time: 0.175240 Aug 19 21:10:29.520821 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 118/265] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:29 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:30.541303 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-bba66940-32ce-4ea0-8454-f8c1fad2e162 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:30.541932 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-bba66940-32ce-4ea0-8454-f8c1fad2e162 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:30.547963 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bba66940-32ce-4ea0-8454-f8c1fad2e162 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:30.548445 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bba66940-32ce-4ea0-8454-f8c1fad2e162 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:30.548872 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bba66940-32ce-4ea0-8454-f8c1fad2e162 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:30.549557 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bba66940-32ce-4ea0-8454-f8c1fad2e162 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:30.550061 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bba66940-32ce-4ea0-8454-f8c1fad2e162 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:30.550480 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bba66940-32ce-4ea0-8454-f8c1fad2e162 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:30.686429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-bba66940-32ce-4ea0-8454-f8c1fad2e162 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:30.695280 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-bba66940-32ce-4ea0-8454-f8c1fad2e162 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1520 microversion: 2.1 time: 0.157770 Aug 19 21:10:30.695846 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 148/266] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:30 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:31.716555 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-a981fb13-d3a4-4062-9c57-61fc035236b6 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:31.717156 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-a981fb13-d3a4-4062-9c57-61fc035236b6 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:31.724103 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a981fb13-d3a4-4062-9c57-61fc035236b6 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:31.724856 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a981fb13-d3a4-4062-9c57-61fc035236b6 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:31.725455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a981fb13-d3a4-4062-9c57-61fc035236b6 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:31.726357 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a981fb13-d3a4-4062-9c57-61fc035236b6 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:31.726983 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a981fb13-d3a4-4062-9c57-61fc035236b6 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:31.727553 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a981fb13-d3a4-4062-9c57-61fc035236b6 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:31.888064 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-a981fb13-d3a4-4062-9c57-61fc035236b6 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:31.896834 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-a981fb13-d3a4-4062-9c57-61fc035236b6 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1520 microversion: 2.1 time: 0.183919 Aug 19 21:10:31.897424 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 119/267] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:31 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:32.918621 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-d1f274cd-1c53-49e4-83ab-f5469dec5f5e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:32.919237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-d1f274cd-1c53-49e4-83ab-f5469dec5f5e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:32.926316 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d1f274cd-1c53-49e4-83ab-f5469dec5f5e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:32.926826 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d1f274cd-1c53-49e4-83ab-f5469dec5f5e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:32.927275 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d1f274cd-1c53-49e4-83ab-f5469dec5f5e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:32.928203 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d1f274cd-1c53-49e4-83ab-f5469dec5f5e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:32.928665 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d1f274cd-1c53-49e4-83ab-f5469dec5f5e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:32.929090 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d1f274cd-1c53-49e4-83ab-f5469dec5f5e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:33.121210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-d1f274cd-1c53-49e4-83ab-f5469dec5f5e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:33.130737 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-d1f274cd-1c53-49e4-83ab-f5469dec5f5e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1520 microversion: 2.1 time: 0.215829 Aug 19 21:10:33.131362 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 149/268] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:32 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:34.167348 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-4d3780d7-6a6a-4955-bdc7-74093f905a48 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:34.168054 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-4d3780d7-6a6a-4955-bdc7-74093f905a48 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:34.174632 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4d3780d7-6a6a-4955-bdc7-74093f905a48 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:34.175113 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4d3780d7-6a6a-4955-bdc7-74093f905a48 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:34.175669 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4d3780d7-6a6a-4955-bdc7-74093f905a48 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:34.177083 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4d3780d7-6a6a-4955-bdc7-74093f905a48 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:34.177539 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4d3780d7-6a6a-4955-bdc7-74093f905a48 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:34.177986 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4d3780d7-6a6a-4955-bdc7-74093f905a48 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:34.182109 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:34.320160 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-4d3780d7-6a6a-4955-bdc7-74093f905a48 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:34.328427 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-4d3780d7-6a6a-4955-bdc7-74093f905a48 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1520 microversion: 2.1 time: 0.164942 Aug 19 21:10:34.329276 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 120/269] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:34 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:35.356567 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-1431cbd5-0f48-4324-8395-360f61e65d06 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:35.357939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-1431cbd5-0f48-4324-8395-360f61e65d06 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:35.365451 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1431cbd5-0f48-4324-8395-360f61e65d06 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:35.366377 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1431cbd5-0f48-4324-8395-360f61e65d06 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:35.367042 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1431cbd5-0f48-4324-8395-360f61e65d06 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:35.368178 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1431cbd5-0f48-4324-8395-360f61e65d06 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:35.369192 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1431cbd5-0f48-4324-8395-360f61e65d06 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:35.370068 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1431cbd5-0f48-4324-8395-360f61e65d06 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:35.540814 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-1431cbd5-0f48-4324-8395-360f61e65d06 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:35.548581 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-1431cbd5-0f48-4324-8395-360f61e65d06 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1520 microversion: 2.1 time: 0.196281 Aug 19 21:10:35.549179 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 150/270] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:35 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:36.573995 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-509a648c-db99-469a-b333-cc8611f2d7be tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:36.574853 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-509a648c-db99-469a-b333-cc8611f2d7be tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:36.585017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-509a648c-db99-469a-b333-cc8611f2d7be tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:36.585879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-509a648c-db99-469a-b333-cc8611f2d7be tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:36.586324 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-509a648c-db99-469a-b333-cc8611f2d7be tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:36.587280 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-509a648c-db99-469a-b333-cc8611f2d7be tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:36.588032 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-509a648c-db99-469a-b333-cc8611f2d7be tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:36.588779 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-509a648c-db99-469a-b333-cc8611f2d7be tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:36.780060 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-509a648c-db99-469a-b333-cc8611f2d7be tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:36.796202 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-509a648c-db99-469a-b333-cc8611f2d7be tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1500 microversion: 2.1 time: 0.227531 Aug 19 21:10:36.797329 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 121/271] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:36 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1500 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:36.819981 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-85d9f818-dc58-4554-88f6-53d9eee0fe0e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4ea0bd0-7dde-4e3a-95aa-603569e4674c"}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:10:36.824921 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-85d9f818-dc58-4554-88f6-53d9eee0fe0e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:36.830664 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=22 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:36.833327 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-85d9f818-dc58-4554-88f6-53d9eee0fe0e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:36.834339 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-85d9f818-dc58-4554-88f6-53d9eee0fe0e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:36.835188 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-85d9f818-dc58-4554-88f6-53d9eee0fe0e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:36.838764 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-85d9f818-dc58-4554-88f6-53d9eee0fe0e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:36.839686 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-85d9f818-dc58-4554-88f6-53d9eee0fe0e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:36.840350 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-85d9f818-dc58-4554-88f6-53d9eee0fe0e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:36.887648 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-85d9f818-dc58-4554-88f6-53d9eee0fe0e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] HTTP exception thrown: Cannot 'attach_volume' instance e363b06b-e5dd-48c8-a0d8-afdfa5bad759 while it is in vm_state rescued Aug 19 21:10:36.889701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-85d9f818-dc58-4554-88f6-53d9eee0fe0e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Request method failure captured: Aug 19 21:10:36.889701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: POST /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759/os-volume_attachments HTTP/1.1 Aug 19 21:10:36.889701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:10:36.889701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:10:36.889701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:10:36.889701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 74 Aug 19 21:10:36.889701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:10:36.889701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:10:36.889701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:10:36.889701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:10:36.889701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__u_fqu6__XAfEE8we4aMURTivVATLB4jAgDmOFji8LAe6kA4gLjm1nrouNEf5jjDjNj26q2gqZM2Is0Dwmcg8wVlRCJeDOlaq0WksfDdNjKfw7dq4UB7lXlKAtdfsuLSIAySQq0SR_EwssRHXqVK43vCJaIMBR00xJyCTcakpc4R8U Aug 19 21:10:36.889701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:10:36.889701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:10:36.889701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:10:36.889701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:10:36.889701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:10:36.889701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:10:36.889701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: 1c4004ba973b4454865b889d6d1e049a Aug 19 21:10:36.889701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1218485444 Aug 19 21:10:36.889701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:10:36.889701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:10:36.891088 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1c4004ba973b4454865b889d6d1e049a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c4004ba973b4454865b889d6d1e049a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1c4004ba973b4454865b889d6d1e049a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c4004ba973b4454865b889d6d1e049a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:10:36.891088 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1218485444 Aug 19 21:10:36.891088 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: 1c4004ba973b4454865b889d6d1e049a Aug 19 21:10:36.891088 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1218485444 Aug 19 21:10:36.891088 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-ServerRescueNegativeTestJSON-1218485444-project Aug 19 21:10:36.891088 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:10:36.891088 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:10:36.891088 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: e8e345dbc2114b718c98c70844352c63 Aug 19 21:10:36.891088 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1218485444-project Aug 19 21:10:36.891088 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Aug 19 21:10:36.891088 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {"volumeAttachment": {"volumeId": "e4ea0bd0-7dde-4e3a-95aa-603569e4674c"}} Aug 19 21:10:36.891088 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: > Aug 19 21:10:36.891797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Cannot 'attach_volume' instance e363b06b-e5dd-48c8-a0d8-afdfa5bad759 while it is in vm_state rescued Aug 19 21:10:36.891797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'server_id': 'e363b06b-e5dd-48c8-a0d8-afdfa5bad759', 'body': {'volumeAttachment': {'volumeId': 'e4ea0bd0-7dde-4e3a-95aa-603569e4674c'}}} Aug 19 21:10:36.891797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:10:36.891797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:10:36.891797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 19 21:10:36.891797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 19 21:10:36.891797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 19 21:10:36.891797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 19 21:10:36.891797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 19 21:10:36.891797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 19 21:10:36.891797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e363b06b-e5dd-48c8-a0d8-afdfa5bad759 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 19 21:10:36.891797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:10:36.891797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:10:36.891797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:10:36.891797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:10:36.891797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:10:36.891797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:10:36.891797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:10:36.891797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:10:36.892936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:10:36.892936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:10:36.892936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 21:10:36.892936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 21:10:36.892936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 21:10:36.892936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 21:10:36.892936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 21:10:36.892936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 21:10:36.892936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 19 21:10:36.892936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 19 21:10:36.892936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 19 21:10:36.892936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 19 21:10:36.892936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e363b06b-e5dd-48c8-a0d8-afdfa5bad759 while it is in vm_state rescued Aug 19 21:10:36.892936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:10:36.892936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:10:36.892936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:10:36.892936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:10:36.892936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:10:36.892936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:10:36.894020 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:10:36.894020 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:10:36.894020 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e363b06b-e5dd-48c8-a0d8-afdfa5bad759 while it is in vm_state rescued Aug 19 21:10:36.894020 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:10:36.894020 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-85d9f818-dc58-4554-88f6-53d9eee0fe0e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Returning 409 to user: Cannot 'attach_volume' instance e363b06b-e5dd-48c8-a0d8-afdfa5bad759 while it is in vm_state rescued {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:10:36.894020 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-85d9f818-dc58-4554-88f6-53d9eee0fe0e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "POST /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.076384 Aug 19 21:10:36.894020 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 151/272] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Aug 19 21:10:36 2022] POST /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759/os-volume_attachments => generated 152 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 19 21:10:36.900950 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-6dffd2de-1dd2-45dc-8954-027baae0d048 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:10:36.901497 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-6dffd2de-1dd2-45dc-8954-027baae0d048 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:36.908224 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6dffd2de-1dd2-45dc-8954-027baae0d048 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:36.908723 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6dffd2de-1dd2-45dc-8954-027baae0d048 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:36.909208 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6dffd2de-1dd2-45dc-8954-027baae0d048 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:36.909963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6dffd2de-1dd2-45dc-8954-027baae0d048 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:36.910536 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6dffd2de-1dd2-45dc-8954-027baae0d048 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:36.911239 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6dffd2de-1dd2-45dc-8954-027baae0d048 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:36.992262 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-6dffd2de-1dd2-45dc-8954-027baae0d048 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "POST /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759/action" status: 202 len: 0 microversion: 2.1 time: 0.094801 Aug 19 21:10:36.994167 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 122/273] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Aug 19 21:10:36 2022] POST /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:10:37.007658 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c74a39d3-bb82-4077-b9f4-3fd194df4902 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:37.008740 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-c74a39d3-bb82-4077-b9f4-3fd194df4902 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:37.021046 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c74a39d3-bb82-4077-b9f4-3fd194df4902 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:37.021961 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c74a39d3-bb82-4077-b9f4-3fd194df4902 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:37.022754 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c74a39d3-bb82-4077-b9f4-3fd194df4902 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:37.024061 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c74a39d3-bb82-4077-b9f4-3fd194df4902 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:37.024912 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c74a39d3-bb82-4077-b9f4-3fd194df4902 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:37.025705 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c74a39d3-bb82-4077-b9f4-3fd194df4902 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:37.188389 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c74a39d3-bb82-4077-b9f4-3fd194df4902 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:37.198050 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-c74a39d3-bb82-4077-b9f4-3fd194df4902 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1508 microversion: 2.1 time: 0.198969 Aug 19 21:10:37.198631 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 152/274] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:36 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1508 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:38.220793 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-98b83d17-a6e9-47e4-ae9f-70bb495cc061 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:38.221602 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-98b83d17-a6e9-47e4-ae9f-70bb495cc061 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:38.228596 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-98b83d17-a6e9-47e4-ae9f-70bb495cc061 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:38.229305 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-98b83d17-a6e9-47e4-ae9f-70bb495cc061 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:38.229930 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-98b83d17-a6e9-47e4-ae9f-70bb495cc061 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:38.230630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-98b83d17-a6e9-47e4-ae9f-70bb495cc061 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:38.231283 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-98b83d17-a6e9-47e4-ae9f-70bb495cc061 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:38.231710 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-98b83d17-a6e9-47e4-ae9f-70bb495cc061 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:38.393840 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-98b83d17-a6e9-47e4-ae9f-70bb495cc061 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:38.403939 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-98b83d17-a6e9-47e4-ae9f-70bb495cc061 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1508 microversion: 2.1 time: 0.188415 Aug 19 21:10:38.404725 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 123/275] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:38 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:39.427608 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-276a8829-74e1-42ef-a0e7-4a5c807767eb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:39.428395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-276a8829-74e1-42ef-a0e7-4a5c807767eb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:39.435495 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-276a8829-74e1-42ef-a0e7-4a5c807767eb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:39.435984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-276a8829-74e1-42ef-a0e7-4a5c807767eb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:39.436423 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-276a8829-74e1-42ef-a0e7-4a5c807767eb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:39.437125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-276a8829-74e1-42ef-a0e7-4a5c807767eb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:39.437577 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-276a8829-74e1-42ef-a0e7-4a5c807767eb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:39.438025 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-276a8829-74e1-42ef-a0e7-4a5c807767eb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:39.600475 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-276a8829-74e1-42ef-a0e7-4a5c807767eb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:39.608352 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-276a8829-74e1-42ef-a0e7-4a5c807767eb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1508 microversion: 2.1 time: 0.186422 Aug 19 21:10:39.608988 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 153/276] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:39 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:40.630166 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d4c37587-d260-4562-95c5-6fae2d12fdad tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:40.630720 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-d4c37587-d260-4562-95c5-6fae2d12fdad tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:40.639341 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d4c37587-d260-4562-95c5-6fae2d12fdad tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:40.639912 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d4c37587-d260-4562-95c5-6fae2d12fdad tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:40.640358 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d4c37587-d260-4562-95c5-6fae2d12fdad tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:40.641210 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d4c37587-d260-4562-95c5-6fae2d12fdad tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:40.641692 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d4c37587-d260-4562-95c5-6fae2d12fdad tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:40.642398 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d4c37587-d260-4562-95c5-6fae2d12fdad tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:40.797020 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-d4c37587-d260-4562-95c5-6fae2d12fdad tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:40.805191 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-d4c37587-d260-4562-95c5-6fae2d12fdad tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1508 microversion: 2.1 time: 0.179330 Aug 19 21:10:40.805791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 124/277] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:40 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:41.826790 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-997105be-23f2-4886-9450-b27bf229bd1d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:41.827387 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-997105be-23f2-4886-9450-b27bf229bd1d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:41.833936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-997105be-23f2-4886-9450-b27bf229bd1d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:41.834424 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-997105be-23f2-4886-9450-b27bf229bd1d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:41.834856 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-997105be-23f2-4886-9450-b27bf229bd1d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:41.835556 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-997105be-23f2-4886-9450-b27bf229bd1d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:41.836019 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-997105be-23f2-4886-9450-b27bf229bd1d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:41.836437 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-997105be-23f2-4886-9450-b27bf229bd1d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:42.022376 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-997105be-23f2-4886-9450-b27bf229bd1d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:42.030871 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-997105be-23f2-4886-9450-b27bf229bd1d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1508 microversion: 2.1 time: 0.207904 Aug 19 21:10:42.031583 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 154/278] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:41 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1508 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:43.053228 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-2528bf1b-46f5-4cfa-aa95-b5de6c1b8882 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:43.053894 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-2528bf1b-46f5-4cfa-aa95-b5de6c1b8882 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:43.061933 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2528bf1b-46f5-4cfa-aa95-b5de6c1b8882 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:43.061933 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2528bf1b-46f5-4cfa-aa95-b5de6c1b8882 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:43.064303 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2528bf1b-46f5-4cfa-aa95-b5de6c1b8882 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:43.065241 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2528bf1b-46f5-4cfa-aa95-b5de6c1b8882 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:43.065728 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2528bf1b-46f5-4cfa-aa95-b5de6c1b8882 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:43.066882 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2528bf1b-46f5-4cfa-aa95-b5de6c1b8882 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:43.212888 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-2528bf1b-46f5-4cfa-aa95-b5de6c1b8882 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:43.224930 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-2528bf1b-46f5-4cfa-aa95-b5de6c1b8882 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1508 microversion: 2.1 time: 0.175873 Aug 19 21:10:43.225607 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 125/279] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:43 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:44.246725 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c1bcbb13-e2ff-4803-b490-422719f3e89a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:44.247346 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-c1bcbb13-e2ff-4803-b490-422719f3e89a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:44.254454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c1bcbb13-e2ff-4803-b490-422719f3e89a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:44.254943 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c1bcbb13-e2ff-4803-b490-422719f3e89a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:44.255372 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c1bcbb13-e2ff-4803-b490-422719f3e89a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:44.256078 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c1bcbb13-e2ff-4803-b490-422719f3e89a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:44.256527 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c1bcbb13-e2ff-4803-b490-422719f3e89a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:44.256941 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c1bcbb13-e2ff-4803-b490-422719f3e89a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:44.394469 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c1bcbb13-e2ff-4803-b490-422719f3e89a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:44.402290 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-c1bcbb13-e2ff-4803-b490-422719f3e89a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1508 microversion: 2.1 time: 0.159343 Aug 19 21:10:44.403654 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 155/280] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:44 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:45.430492 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-e232a6c4-4ae4-4364-89fa-652e2e53de46 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:45.431029 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-e232a6c4-4ae4-4364-89fa-652e2e53de46 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:45.437681 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e232a6c4-4ae4-4364-89fa-652e2e53de46 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:45.438217 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e232a6c4-4ae4-4364-89fa-652e2e53de46 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:45.438652 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e232a6c4-4ae4-4364-89fa-652e2e53de46 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:45.439354 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e232a6c4-4ae4-4364-89fa-652e2e53de46 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:45.439810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e232a6c4-4ae4-4364-89fa-652e2e53de46 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:45.440235 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e232a6c4-4ae4-4364-89fa-652e2e53de46 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:45.587624 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-e232a6c4-4ae4-4364-89fa-652e2e53de46 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:45.596020 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-e232a6c4-4ae4-4364-89fa-652e2e53de46 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1508 microversion: 2.1 time: 0.175483 Aug 19 21:10:45.596616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 126/281] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:45 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:46.618924 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-58a1c4e7-f1b8-4420-90fb-52a834af0dd4 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:46.619469 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-58a1c4e7-f1b8-4420-90fb-52a834af0dd4 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:46.625699 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58a1c4e7-f1b8-4420-90fb-52a834af0dd4 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:46.626230 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58a1c4e7-f1b8-4420-90fb-52a834af0dd4 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:46.626662 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58a1c4e7-f1b8-4420-90fb-52a834af0dd4 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:46.627362 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58a1c4e7-f1b8-4420-90fb-52a834af0dd4 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:46.627810 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58a1c4e7-f1b8-4420-90fb-52a834af0dd4 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:46.628529 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58a1c4e7-f1b8-4420-90fb-52a834af0dd4 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:46.778151 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-58a1c4e7-f1b8-4420-90fb-52a834af0dd4 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:46.786738 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-58a1c4e7-f1b8-4420-90fb-52a834af0dd4 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1508 microversion: 2.1 time: 0.171720 Aug 19 21:10:46.787299 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 156/282] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:46 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:47.808926 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-c032d3c4-1c8c-40b6-b791-2f9bf4a5769b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:47.809592 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-c032d3c4-1c8c-40b6-b791-2f9bf4a5769b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:47.818165 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c032d3c4-1c8c-40b6-b791-2f9bf4a5769b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:47.818774 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c032d3c4-1c8c-40b6-b791-2f9bf4a5769b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:47.819317 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c032d3c4-1c8c-40b6-b791-2f9bf4a5769b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:47.820142 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c032d3c4-1c8c-40b6-b791-2f9bf4a5769b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:47.820716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c032d3c4-1c8c-40b6-b791-2f9bf4a5769b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:47.821305 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c032d3c4-1c8c-40b6-b791-2f9bf4a5769b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:47.969909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-c032d3c4-1c8c-40b6-b791-2f9bf4a5769b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:47.979311 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-c032d3c4-1c8c-40b6-b791-2f9bf4a5769b tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1508 microversion: 2.1 time: 0.174727 Aug 19 21:10:47.979913 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 127/283] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:47 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:49.009450 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-6bddfa91-1ed3-4c82-b780-0c456453059d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:49.010611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-6bddfa91-1ed3-4c82-b780-0c456453059d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:49.022664 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6bddfa91-1ed3-4c82-b780-0c456453059d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:49.023692 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6bddfa91-1ed3-4c82-b780-0c456453059d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:49.024445 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6bddfa91-1ed3-4c82-b780-0c456453059d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:49.026646 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6bddfa91-1ed3-4c82-b780-0c456453059d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:49.027925 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6bddfa91-1ed3-4c82-b780-0c456453059d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:49.028869 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6bddfa91-1ed3-4c82-b780-0c456453059d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:49.257298 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-6bddfa91-1ed3-4c82-b780-0c456453059d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:49.267423 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-6bddfa91-1ed3-4c82-b780-0c456453059d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1514 microversion: 2.1 time: 0.266880 Aug 19 21:10:49.268010 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 157/284] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:48 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1514 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:50.836863 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-35281605-b2a8-4982-b4c0-015a0096b6f1 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Action: 'create', calling method: .version_select at 0x7f740be61f70>, body: {"keypair": {"name": "tempest-keypair-738933856", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIw4o/sp52vm6UbQ2BOZrPEf0B9TAU67GlkXJ5J3GvP1A0c/U8KPI53tw2KywWh/YT0x2Bh+PrTz1lMQyQs5N39uVcdGnC6j5N2SpIGoam5vqEhtZGt1jsPkQfyu7fbT+Q=="}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:10:50.848608 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=28 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:50.865113 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-35281605-b2a8-4982-b4c0-015a0096b6f1 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Getting quotas for project 1c4004ba973b4454865b889d6d1e049a. Resources: {'key_pairs'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:10:50.870673 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-35281605-b2a8-4982-b4c0-015a0096b6f1 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Getting quotas for user e8e345dbc2114b718c98c70844352c63 and project 1c4004ba973b4454865b889d6d1e049a. Resources: {'key_pairs'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:10:50.919892 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-35281605-b2a8-4982-b4c0-015a0096b6f1 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.087662 Aug 19 21:10:50.920673 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 128/285] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Aug 19 21:10:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:10:53.175738 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-65ac3260-22fa-4a23-8817-e9df8e61bd36 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2021449474", "imageRef": "d1f034cf-f103-477b-bbb5-3298c678db05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "191d091b-fd3f-485e-a729-86fc2a15707b"}], "security_groups": [{"name": "tempest-securitygroup--989450270"}], "key_name": "tempest-keypair-738933856", "user_data": "}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:10:53.329345 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.network.neutron [None req-65ac3260-22fa-4a23-8817-e9df8e61bd36 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] validate_networks() for [('191d091b-fd3f-485e-a729-86fc2a15707b', None, None, None, None, None)] {{(pid=120877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 21:10:54.087908 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-65ac3260-22fa-4a23-8817-e9df8e61bd36 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Flavor limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 21:10:54.089150 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-65ac3260-22fa-4a23-8817-e9df8e61bd36 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Image limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 21:10:54.090655 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-65ac3260-22fa-4a23-8817-e9df8e61bd36 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Flavor pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 21:10:54.099467 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-65ac3260-22fa-4a23-8817-e9df8e61bd36 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Image pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 21:10:54.101048 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-65ac3260-22fa-4a23-8817-e9df8e61bd36 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 21:10:54.122943 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-65ac3260-22fa-4a23-8817-e9df8e61bd36 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:54.124285 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-65ac3260-22fa-4a23-8817-e9df8e61bd36 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:54.126163 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-65ac3260-22fa-4a23-8817-e9df8e61bd36 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:54.128571 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-65ac3260-22fa-4a23-8817-e9df8e61bd36 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:54.130244 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-65ac3260-22fa-4a23-8817-e9df8e61bd36 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:54.132013 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-65ac3260-22fa-4a23-8817-e9df8e61bd36 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:54.200972 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-65ac3260-22fa-4a23-8817-e9df8e61bd36 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Getting quotas for project 1c4004ba973b4454865b889d6d1e049a. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:10:54.209252 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-65ac3260-22fa-4a23-8817-e9df8e61bd36 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Getting quotas for user e8e345dbc2114b718c98c70844352c63 and project 1c4004ba973b4454865b889d6d1e049a. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:10:54.232979 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-65ac3260-22fa-4a23-8817-e9df8e61bd36 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Going to run 1 instances... {{(pid=120877) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 21:10:54.238480 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-65ac3260-22fa-4a23-8817-e9df8e61bd36 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f034cf-f103-477b-bbb5-3298c678db05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 21:10:54.315644 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-65ac3260-22fa-4a23-8817-e9df8e61bd36 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.144343 Aug 19 21:10:54.319140 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 158/286] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Aug 19 21:10:53 2022] POST /compute/v2.1/servers => generated 408 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 21:10:54.342179 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-3284ebad-20fa-4470-92a6-66b9b03364b2 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:54.346201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-3284ebad-20fa-4470-92a6-66b9b03364b2 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:54.447161 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-3284ebad-20fa-4470-92a6-66b9b03364b2 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:54.455230 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-3284ebad-20fa-4470-92a6-66b9b03364b2 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1245 microversion: 2.1 time: 0.124661 Aug 19 21:10:54.456076 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 129/287] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:54 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1245 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:10:55.492653 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-57b67605-e08a-44cd-8a23-9aaf0ae36c43 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:55.497733 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-57b67605-e08a-44cd-8a23-9aaf0ae36c43 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:55.522932 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-57b67605-e08a-44cd-8a23-9aaf0ae36c43 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:55.523444 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-57b67605-e08a-44cd-8a23-9aaf0ae36c43 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:55.524525 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-57b67605-e08a-44cd-8a23-9aaf0ae36c43 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:55.525386 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-57b67605-e08a-44cd-8a23-9aaf0ae36c43 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:55.528665 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-57b67605-e08a-44cd-8a23-9aaf0ae36c43 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:55.532064 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-57b67605-e08a-44cd-8a23-9aaf0ae36c43 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:55.686776 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-57b67605-e08a-44cd-8a23-9aaf0ae36c43 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:55.708460 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-57b67605-e08a-44cd-8a23-9aaf0ae36c43 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1297 microversion: 2.1 time: 0.225626 Aug 19 21:10:55.710258 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 159/288] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:55 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1297 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:56.744260 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-dd8616ce-29e0-4b3a-b179-cd798c44a01e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:56.744886 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-dd8616ce-29e0-4b3a-b179-cd798c44a01e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:56.752197 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dd8616ce-29e0-4b3a-b179-cd798c44a01e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:56.752695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dd8616ce-29e0-4b3a-b179-cd798c44a01e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:56.753129 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dd8616ce-29e0-4b3a-b179-cd798c44a01e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:56.754446 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dd8616ce-29e0-4b3a-b179-cd798c44a01e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:56.754910 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dd8616ce-29e0-4b3a-b179-cd798c44a01e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:56.755535 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dd8616ce-29e0-4b3a-b179-cd798c44a01e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:56.840961 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-dd8616ce-29e0-4b3a-b179-cd798c44a01e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:56.859293 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-dd8616ce-29e0-4b3a-b179-cd798c44a01e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1303 microversion: 2.1 time: 0.118433 Aug 19 21:10:56.875006 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 130/289] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:56 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1303 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:10:57.897722 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c2689d7c-18c8-4594-a7b0-2618c505ba6d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:57.898947 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-c2689d7c-18c8-4594-a7b0-2618c505ba6d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:57.905827 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c2689d7c-18c8-4594-a7b0-2618c505ba6d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:57.906571 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c2689d7c-18c8-4594-a7b0-2618c505ba6d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:57.907174 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c2689d7c-18c8-4594-a7b0-2618c505ba6d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:57.908085 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c2689d7c-18c8-4594-a7b0-2618c505ba6d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:57.908733 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c2689d7c-18c8-4594-a7b0-2618c505ba6d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:57.909575 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c2689d7c-18c8-4594-a7b0-2618c505ba6d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:57.913302 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=80 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:10:58.206338 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c2689d7c-18c8-4594-a7b0-2618c505ba6d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:58.223901 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-c2689d7c-18c8-4594-a7b0-2618c505ba6d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1370 microversion: 2.1 time: 0.330002 Aug 19 21:10:58.225753 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 160/290] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:57 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1370 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:10:58.622908 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-69ed9a03-963e-4c50-9cc3-e9d47daea94a req-67b95fd9-2e5b-4fff-9cba-3b55df16b9b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7df3ead0-b255-4b0c-8fa7-f9ae80138539", "tag": "3a4cbe7a-9f6d-4454-9ea2-92df8cfb98b9"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:10:58.642410 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-69ed9a03-963e-4c50-9cc3-e9d47daea94a req-67b95fd9-2e5b-4fff-9cba-3b55df16b9b6 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:58.643540 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-69ed9a03-963e-4c50-9cc3-e9d47daea94a req-67b95fd9-2e5b-4fff-9cba-3b55df16b9b6 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:58.647469 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-69ed9a03-963e-4c50-9cc3-e9d47daea94a req-67b95fd9-2e5b-4fff-9cba-3b55df16b9b6 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:58.670562 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-69ed9a03-963e-4c50-9cc3-e9d47daea94a req-67b95fd9-2e5b-4fff-9cba-3b55df16b9b6 service nova] Creating event network-changed:3a4cbe7a-9f6d-4454-9ea2-92df8cfb98b9 for instance 7df3ead0-b255-4b0c-8fa7-f9ae80138539 on hv-cinder-85220 Aug 19 21:10:58.678121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-69ed9a03-963e-4c50-9cc3-e9d47daea94a req-67b95fd9-2e5b-4fff-9cba-3b55df16b9b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063294 Aug 19 21:10:58.679050 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 131/291] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:10:59.246048 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-551ef3de-9fb1-4bc3-b907-9b8b91b63a1d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:10:59.246654 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-551ef3de-9fb1-4bc3-b907-9b8b91b63a1d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:10:59.268665 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-551ef3de-9fb1-4bc3-b907-9b8b91b63a1d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:59.270025 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-551ef3de-9fb1-4bc3-b907-9b8b91b63a1d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:59.274850 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-551ef3de-9fb1-4bc3-b907-9b8b91b63a1d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:59.275762 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-551ef3de-9fb1-4bc3-b907-9b8b91b63a1d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:10:59.276491 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-551ef3de-9fb1-4bc3-b907-9b8b91b63a1d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:10:59.283832 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-551ef3de-9fb1-4bc3-b907-9b8b91b63a1d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:10:59.606873 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-551ef3de-9fb1-4bc3-b907-9b8b91b63a1d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:10:59.637349 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-551ef3de-9fb1-4bc3-b907-9b8b91b63a1d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1370 microversion: 2.1 time: 0.394932 Aug 19 21:10:59.649469 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 161/292] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:10:59 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1370 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:00.671082 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-62f45edb-918c-4a0c-b0fd-24d99d77f13a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:00.671790 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-62f45edb-918c-4a0c-b0fd-24d99d77f13a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:00.679649 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-62f45edb-918c-4a0c-b0fd-24d99d77f13a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:00.680134 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-62f45edb-918c-4a0c-b0fd-24d99d77f13a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:00.680786 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-62f45edb-918c-4a0c-b0fd-24d99d77f13a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:00.681689 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-62f45edb-918c-4a0c-b0fd-24d99d77f13a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:00.682335 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-62f45edb-918c-4a0c-b0fd-24d99d77f13a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:00.682965 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-62f45edb-918c-4a0c-b0fd-24d99d77f13a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:00.835452 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-62f45edb-918c-4a0c-b0fd-24d99d77f13a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:00.843964 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-62f45edb-918c-4a0c-b0fd-24d99d77f13a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1370 microversion: 2.1 time: 0.178043 Aug 19 21:11:00.844566 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 132/293] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:00 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:11:01.866083 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-1240c17a-e311-4049-ba00-48b33f271319 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:01.867560 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-1240c17a-e311-4049-ba00-48b33f271319 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:01.882137 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1240c17a-e311-4049-ba00-48b33f271319 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:01.886081 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1240c17a-e311-4049-ba00-48b33f271319 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:01.886904 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1240c17a-e311-4049-ba00-48b33f271319 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:01.890410 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1240c17a-e311-4049-ba00-48b33f271319 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:01.892198 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1240c17a-e311-4049-ba00-48b33f271319 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:01.892847 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1240c17a-e311-4049-ba00-48b33f271319 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:02.151611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-1240c17a-e311-4049-ba00-48b33f271319 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:02.162968 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-1240c17a-e311-4049-ba00-48b33f271319 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1370 microversion: 2.1 time: 0.301635 Aug 19 21:11:02.164146 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 162/294] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:01 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1370 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:03.184840 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d39a19dd-71e0-4784-bc23-d165c18ffd7d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:03.185455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-d39a19dd-71e0-4784-bc23-d165c18ffd7d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:03.198873 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d39a19dd-71e0-4784-bc23-d165c18ffd7d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:03.199283 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d39a19dd-71e0-4784-bc23-d165c18ffd7d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:03.199711 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d39a19dd-71e0-4784-bc23-d165c18ffd7d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:03.200717 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d39a19dd-71e0-4784-bc23-d165c18ffd7d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:03.201327 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d39a19dd-71e0-4784-bc23-d165c18ffd7d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:03.201931 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d39a19dd-71e0-4784-bc23-d165c18ffd7d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:03.592282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-d39a19dd-71e0-4784-bc23-d165c18ffd7d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:03.607229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-d39a19dd-71e0-4784-bc23-d165c18ffd7d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1370 microversion: 2.1 time: 0.424286 Aug 19 21:11:03.610982 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 133/295] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:03 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1370 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:04.632483 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-2eb36006-a80b-465a-ad25-f446c460f4cd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:04.633111 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-2eb36006-a80b-465a-ad25-f446c460f4cd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:04.636975 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=2 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:04.643186 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=6 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:04.660348 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2eb36006-a80b-465a-ad25-f446c460f4cd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:04.661278 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2eb36006-a80b-465a-ad25-f446c460f4cd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:04.661944 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2eb36006-a80b-465a-ad25-f446c460f4cd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:04.662819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2eb36006-a80b-465a-ad25-f446c460f4cd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:04.663612 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2eb36006-a80b-465a-ad25-f446c460f4cd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:04.664199 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2eb36006-a80b-465a-ad25-f446c460f4cd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:05.134286 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-2eb36006-a80b-465a-ad25-f446c460f4cd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:05.144612 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-2eb36006-a80b-465a-ad25-f446c460f4cd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1370 microversion: 2.1 time: 0.517162 Aug 19 21:11:05.158692 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 163/296] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:04 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1370 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:06.168088 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-deecff24-d8be-410f-92c6-233c3a1ff30f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:06.168700 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-deecff24-d8be-410f-92c6-233c3a1ff30f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:06.171435 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=6 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:06.182008 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-deecff24-d8be-410f-92c6-233c3a1ff30f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:06.187768 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-deecff24-d8be-410f-92c6-233c3a1ff30f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:06.203545 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-deecff24-d8be-410f-92c6-233c3a1ff30f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:06.211500 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-deecff24-d8be-410f-92c6-233c3a1ff30f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:06.212000 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-deecff24-d8be-410f-92c6-233c3a1ff30f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:06.212443 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-deecff24-d8be-410f-92c6-233c3a1ff30f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:06.598733 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:06.954283 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-deecff24-d8be-410f-92c6-233c3a1ff30f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:06.963147 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-deecff24-d8be-410f-92c6-233c3a1ff30f tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1370 microversion: 2.1 time: 0.799642 Aug 19 21:11:06.996092 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 134/297] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:06 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1370 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:07.309558 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-92d0bfe5-8b19-4a5a-a467-b41a29f58a1b req-93036c07-0e12-47a0-8f97-7ca3987e7792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7df3ead0-b255-4b0c-8fa7-f9ae80138539", "name": "network-vif-plugged", "status": "completed", "tag": "3a4cbe7a-9f6d-4454-9ea2-92df8cfb98b9"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:11:07.319631 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:07.357680 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-92d0bfe5-8b19-4a5a-a467-b41a29f58a1b req-93036c07-0e12-47a0-8f97-7ca3987e7792 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:07.359307 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-92d0bfe5-8b19-4a5a-a467-b41a29f58a1b req-93036c07-0e12-47a0-8f97-7ca3987e7792 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:07.360216 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-92d0bfe5-8b19-4a5a-a467-b41a29f58a1b req-93036c07-0e12-47a0-8f97-7ca3987e7792 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:07.393029 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-92d0bfe5-8b19-4a5a-a467-b41a29f58a1b req-93036c07-0e12-47a0-8f97-7ca3987e7792 service nova] Creating event network-vif-plugged:3a4cbe7a-9f6d-4454-9ea2-92df8cfb98b9 for instance 7df3ead0-b255-4b0c-8fa7-f9ae80138539 on hv-cinder-85220 Aug 19 21:11:07.401700 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-92d0bfe5-8b19-4a5a-a467-b41a29f58a1b req-93036c07-0e12-47a0-8f97-7ca3987e7792 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097353 Aug 19 21:11:07.403306 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 164/298] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:11:08.021009 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-104be2fd-5c53-42b0-b8bd-4ab278c92196 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:08.024658 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-104be2fd-5c53-42b0-b8bd-4ab278c92196 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:08.040678 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-104be2fd-5c53-42b0-b8bd-4ab278c92196 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:08.043207 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-104be2fd-5c53-42b0-b8bd-4ab278c92196 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:08.043660 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-104be2fd-5c53-42b0-b8bd-4ab278c92196 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:08.046444 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-104be2fd-5c53-42b0-b8bd-4ab278c92196 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:08.048634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-104be2fd-5c53-42b0-b8bd-4ab278c92196 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:08.050012 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-104be2fd-5c53-42b0-b8bd-4ab278c92196 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:08.385366 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-104be2fd-5c53-42b0-b8bd-4ab278c92196 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:08.398100 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-104be2fd-5c53-42b0-b8bd-4ab278c92196 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1370 microversion: 2.1 time: 0.397152 Aug 19 21:11:08.414470 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 135/299] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:07 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1370 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:11:09.432585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-1d76d7b4-f4f2-4c38-9532-9220a45344e7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:09.434248 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-1d76d7b4-f4f2-4c38-9532-9220a45344e7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:09.451645 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1d76d7b4-f4f2-4c38-9532-9220a45344e7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:09.453373 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1d76d7b4-f4f2-4c38-9532-9220a45344e7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:09.453640 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1d76d7b4-f4f2-4c38-9532-9220a45344e7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:09.455627 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1d76d7b4-f4f2-4c38-9532-9220a45344e7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:09.456180 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1d76d7b4-f4f2-4c38-9532-9220a45344e7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:09.457129 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1d76d7b4-f4f2-4c38-9532-9220a45344e7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:09.785665 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-1d76d7b4-f4f2-4c38-9532-9220a45344e7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:09.808427 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-1d76d7b4-f4f2-4c38-9532-9220a45344e7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1370 microversion: 2.1 time: 0.381333 Aug 19 21:11:09.809957 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 165/300] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:09 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1370 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:10.832925 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-abbe9e75-fca6-4608-95fe-f65fd05f4002 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:10.834498 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-abbe9e75-fca6-4608-95fe-f65fd05f4002 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:10.843066 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-abbe9e75-fca6-4608-95fe-f65fd05f4002 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:10.843962 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-abbe9e75-fca6-4608-95fe-f65fd05f4002 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:10.844645 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-abbe9e75-fca6-4608-95fe-f65fd05f4002 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:10.845601 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-abbe9e75-fca6-4608-95fe-f65fd05f4002 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:10.846490 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-abbe9e75-fca6-4608-95fe-f65fd05f4002 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:10.847204 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-abbe9e75-fca6-4608-95fe-f65fd05f4002 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:11.359187 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-abbe9e75-fca6-4608-95fe-f65fd05f4002 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:11.393349 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-abbe9e75-fca6-4608-95fe-f65fd05f4002 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1563 microversion: 2.1 time: 0.564476 Aug 19 21:11:11.400137 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 136/301] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:10 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1563 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:11:11.431603 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-9635542e-737e-4f47-9783-c70cadcf9199 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:11.432180 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-9635542e-737e-4f47-9783-c70cadcf9199 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:11.455634 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9635542e-737e-4f47-9783-c70cadcf9199 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:11.456659 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9635542e-737e-4f47-9783-c70cadcf9199 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:11.457328 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9635542e-737e-4f47-9783-c70cadcf9199 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:11.458293 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9635542e-737e-4f47-9783-c70cadcf9199 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:11.458995 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9635542e-737e-4f47-9783-c70cadcf9199 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:11.459639 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9635542e-737e-4f47-9783-c70cadcf9199 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:11.707509 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-9635542e-737e-4f47-9783-c70cadcf9199 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.287697 Aug 19 21:11:11.708770 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 166/302] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Aug 19 21:11:11 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539/os-interface => generated 284 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:11:13.571171 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-9ecd7b5c-bbb7-47f9-bb93-c4f7e9febb20 req-4d478b7a-4579-4b75-ba39-f8a0a0b30a32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7df3ead0-b255-4b0c-8fa7-f9ae80138539", "tag": "3a4cbe7a-9f6d-4454-9ea2-92df8cfb98b9"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:11:13.603966 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-9ecd7b5c-bbb7-47f9-bb93-c4f7e9febb20 req-4d478b7a-4579-4b75-ba39-f8a0a0b30a32 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:13.604456 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-9ecd7b5c-bbb7-47f9-bb93-c4f7e9febb20 req-4d478b7a-4579-4b75-ba39-f8a0a0b30a32 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:13.604885 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-9ecd7b5c-bbb7-47f9-bb93-c4f7e9febb20 req-4d478b7a-4579-4b75-ba39-f8a0a0b30a32 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:13.627485 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-9ecd7b5c-bbb7-47f9-bb93-c4f7e9febb20 req-4d478b7a-4579-4b75-ba39-f8a0a0b30a32 service nova] Creating event network-changed:3a4cbe7a-9f6d-4454-9ea2-92df8cfb98b9 for instance 7df3ead0-b255-4b0c-8fa7-f9ae80138539 on hv-cinder-85220 Aug 19 21:11:13.649744 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-9ecd7b5c-bbb7-47f9-bb93-c4f7e9febb20 req-4d478b7a-4579-4b75-ba39-f8a0a0b30a32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082063 Aug 19 21:11:13.650869 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 137/303] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:11:18.760623 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-58b80cd6-83fd-42c7-b313-e5d4a43d03a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-25588730", "imageRef": "d1f034cf-f103-477b-bbb5-3298c678db05", "flavorRef": "452", "networks": [{"uuid": "4b7390f6-ea1a-4766-a73e-9b7628c2625b"}]}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:11:18.878737 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.network.neutron [None req-58b80cd6-83fd-42c7-b313-e5d4a43d03a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] validate_networks() for [('4b7390f6-ea1a-4766-a73e-9b7628c2625b', None, None, None, None, None)] {{(pid=120877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 21:11:19.634086 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-58b80cd6-83fd-42c7-b313-e5d4a43d03a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Flavor limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 21:11:19.634086 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-58b80cd6-83fd-42c7-b313-e5d4a43d03a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Image limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 21:11:19.634799 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-58b80cd6-83fd-42c7-b313-e5d4a43d03a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Flavor pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 21:11:19.635220 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-58b80cd6-83fd-42c7-b313-e5d4a43d03a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Image pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 21:11:19.636549 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-58b80cd6-83fd-42c7-b313-e5d4a43d03a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 21:11:19.655401 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58b80cd6-83fd-42c7-b313-e5d4a43d03a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:19.656259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58b80cd6-83fd-42c7-b313-e5d4a43d03a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:19.657104 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58b80cd6-83fd-42c7-b313-e5d4a43d03a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:19.658357 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58b80cd6-83fd-42c7-b313-e5d4a43d03a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:19.660128 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58b80cd6-83fd-42c7-b313-e5d4a43d03a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:19.660872 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58b80cd6-83fd-42c7-b313-e5d4a43d03a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:19.701948 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-58b80cd6-83fd-42c7-b313-e5d4a43d03a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Getting quotas for project c600e063ecf4490087703e6f9c87cefb. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:11:19.711466 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-58b80cd6-83fd-42c7-b313-e5d4a43d03a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Getting quotas for user d0576905fd534e1ead96f5da9a817bb7 and project c600e063ecf4490087703e6f9c87cefb. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:11:19.736757 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-58b80cd6-83fd-42c7-b313-e5d4a43d03a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Going to run 1 instances... {{(pid=120877) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 21:11:19.741210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-58b80cd6-83fd-42c7-b313-e5d4a43d03a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f034cf-f103-477b-bbb5-3298c678db05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 21:11:19.853406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-58b80cd6-83fd-42c7-b313-e5d4a43d03a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.103827 Aug 19 21:11:19.865221 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 167/304] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Aug 19 21:11:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 21:11:19.888616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-e09e68ef-15c8-4ee4-a1a0-dc95a7407e6c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:19.892399 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-e09e68ef-15c8-4ee4-a1a0-dc95a7407e6c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:20.079865 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-e09e68ef-15c8-4ee4-a1a0-dc95a7407e6c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:20.091385 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-e09e68ef-15c8-4ee4-a1a0-dc95a7407e6c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1212 microversion: 2.1 time: 0.217905 Aug 19 21:11:20.101067 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 138/305] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:19 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1212 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:21.116255 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-02d9e0d4-329a-4849-a480-94fe9823c3e5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:21.117336 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-02d9e0d4-329a-4849-a480-94fe9823c3e5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:21.123684 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-02d9e0d4-329a-4849-a480-94fe9823c3e5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:21.124516 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-02d9e0d4-329a-4849-a480-94fe9823c3e5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:21.125143 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-02d9e0d4-329a-4849-a480-94fe9823c3e5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:21.126196 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-02d9e0d4-329a-4849-a480-94fe9823c3e5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:21.126904 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-02d9e0d4-329a-4849-a480-94fe9823c3e5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:21.127512 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-02d9e0d4-329a-4849-a480-94fe9823c3e5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:21.208447 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-02d9e0d4-329a-4849-a480-94fe9823c3e5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:21.217636 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-02d9e0d4-329a-4849-a480-94fe9823c3e5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1216 microversion: 2.1 time: 0.105400 Aug 19 21:11:21.218894 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 168/306] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:21 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1216 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:11:22.244006 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d1e8f26a-3a04-4003-99cc-ba9abdd1f2ec tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:22.244738 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-d1e8f26a-3a04-4003-99cc-ba9abdd1f2ec tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:22.247737 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:22.262654 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d1e8f26a-3a04-4003-99cc-ba9abdd1f2ec tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:22.263315 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d1e8f26a-3a04-4003-99cc-ba9abdd1f2ec tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:22.263853 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d1e8f26a-3a04-4003-99cc-ba9abdd1f2ec tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:22.264837 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d1e8f26a-3a04-4003-99cc-ba9abdd1f2ec tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:22.265506 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d1e8f26a-3a04-4003-99cc-ba9abdd1f2ec tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:22.266159 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d1e8f26a-3a04-4003-99cc-ba9abdd1f2ec tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:22.361900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-d1e8f26a-3a04-4003-99cc-ba9abdd1f2ec tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:22.377247 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-d1e8f26a-3a04-4003-99cc-ba9abdd1f2ec tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1282 microversion: 2.1 time: 0.137138 Aug 19 21:11:22.381745 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 139/307] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:22 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1282 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:23.401425 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e03d6c55-0ddf-43e5-82b0-50d63746ad4c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:23.402115 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-e03d6c55-0ddf-43e5-82b0-50d63746ad4c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:23.412751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e03d6c55-0ddf-43e5-82b0-50d63746ad4c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:23.414589 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e03d6c55-0ddf-43e5-82b0-50d63746ad4c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:23.415544 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e03d6c55-0ddf-43e5-82b0-50d63746ad4c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:23.418174 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e03d6c55-0ddf-43e5-82b0-50d63746ad4c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:23.419282 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e03d6c55-0ddf-43e5-82b0-50d63746ad4c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:23.419947 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e03d6c55-0ddf-43e5-82b0-50d63746ad4c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:23.823731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e03d6c55-0ddf-43e5-82b0-50d63746ad4c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:23.842448 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e03d6c55-0ddf-43e5-82b0-50d63746ad4c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.445984 Aug 19 21:11:23.854468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 169/308] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:23 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:24.282918 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-3a4c44a4-99c5-42f0-9d23-59e7a914067f req-66691a8c-eed6-4722-80ea-63d1c6f56500 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "345e628f-70ab-410e-8b94-06ca1343492e", "tag": "d27c6406-4abb-4095-ad1e-f0db5b6e3763"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:11:24.337843 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-3a4c44a4-99c5-42f0-9d23-59e7a914067f req-66691a8c-eed6-4722-80ea-63d1c6f56500 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:24.348940 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-3a4c44a4-99c5-42f0-9d23-59e7a914067f req-66691a8c-eed6-4722-80ea-63d1c6f56500 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:24.350031 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-3a4c44a4-99c5-42f0-9d23-59e7a914067f req-66691a8c-eed6-4722-80ea-63d1c6f56500 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:24.383022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-3a4c44a4-99c5-42f0-9d23-59e7a914067f req-66691a8c-eed6-4722-80ea-63d1c6f56500 service nova] Creating event network-changed:d27c6406-4abb-4095-ad1e-f0db5b6e3763 for instance 345e628f-70ab-410e-8b94-06ca1343492e on hv-cinder-85220 Aug 19 21:11:24.396448 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-3a4c44a4-99c5-42f0-9d23-59e7a914067f req-66691a8c-eed6-4722-80ea-63d1c6f56500 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123430 Aug 19 21:11:24.397556 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 140/309] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:11:24.885705 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-497544d9-b885-4520-82df-60f018a4e4bd tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:24.887787 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-497544d9-b885-4520-82df-60f018a4e4bd tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:24.909264 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-497544d9-b885-4520-82df-60f018a4e4bd tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:24.911438 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-497544d9-b885-4520-82df-60f018a4e4bd tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:24.918971 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-497544d9-b885-4520-82df-60f018a4e4bd tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:24.922957 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-497544d9-b885-4520-82df-60f018a4e4bd tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:24.926864 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-497544d9-b885-4520-82df-60f018a4e4bd tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:24.928363 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-497544d9-b885-4520-82df-60f018a4e4bd tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:25.276279 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-497544d9-b885-4520-82df-60f018a4e4bd tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:25.308006 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-497544d9-b885-4520-82df-60f018a4e4bd tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.430846 Aug 19 21:11:25.311876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 170/310] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:24 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:26.343747 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-0d2409f8-4590-4d38-a5c4-23c023205809 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:26.345193 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-0d2409f8-4590-4d38-a5c4-23c023205809 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:26.354437 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0d2409f8-4590-4d38-a5c4-23c023205809 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:26.355326 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0d2409f8-4590-4d38-a5c4-23c023205809 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:26.355968 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0d2409f8-4590-4d38-a5c4-23c023205809 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:26.356900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0d2409f8-4590-4d38-a5c4-23c023205809 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:26.357547 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0d2409f8-4590-4d38-a5c4-23c023205809 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:26.358201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0d2409f8-4590-4d38-a5c4-23c023205809 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:26.617228 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-0d2409f8-4590-4d38-a5c4-23c023205809 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:26.633922 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-0d2409f8-4590-4d38-a5c4-23c023205809 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.293980 Aug 19 21:11:26.635110 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 141/311] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:26 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:26.712066 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-7cb2d987-bcd6-47ed-8e32-642cdddc9b88 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Action: 'create', calling method: .version_select at 0x7f740bed54c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2057503836", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVBWChjCEm9gNpc78krN4IM4AYRcbBKt9OOb7m4lmFkbgece2WVuWgaX/rar3oIRm3dmzDhSOFv12d8URG2rOfiFGjQNG9a5zi7z/THhQFSpRL0htHc28/xt9uiTLds4g=="}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:11:26.741174 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-7cb2d987-bcd6-47ed-8e32-642cdddc9b88 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Getting quotas for project cf734543b7e0426d93654f18f0d98e4a. Resources: {'key_pairs'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:11:26.748120 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-7cb2d987-bcd6-47ed-8e32-642cdddc9b88 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Getting quotas for user 90472736cbcf497c89f0ae1582bb5ab0 and project cf734543b7e0426d93654f18f0d98e4a. Resources: {'key_pairs'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:11:26.783538 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-7cb2d987-bcd6-47ed-8e32-642cdddc9b88 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.079511 Aug 19 21:11:26.785000 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 171/312] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Aug 19 21:11:26 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:11:26.837587 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-4ae08b4d-4fed-4fe7-a968-88d2e3a61049 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2052525821", "imageRef": "bafb30c9-8108-4431-8132-2b2ca0efcfa6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2057503836", "networks": [{"uuid": "901c4f72-056d-423e-892a-dea79ec4f278"}]}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:11:26.901699 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.network.neutron [None req-4ae08b4d-4fed-4fe7-a968-88d2e3a61049 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] validate_networks() for [('901c4f72-056d-423e-892a-dea79ec4f278', None, None, None, None, None)] {{(pid=120876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 21:11:27.451425 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-4ae08b4d-4fed-4fe7-a968-88d2e3a61049 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Flavor limits 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 21:11:27.452088 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-4ae08b4d-4fed-4fe7-a968-88d2e3a61049 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Image limits 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 21:11:27.452332 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-4ae08b4d-4fed-4fe7-a968-88d2e3a61049 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Flavor pref 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 21:11:27.452740 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-4ae08b4d-4fed-4fe7-a968-88d2e3a61049 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Image pref 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 21:11:27.453147 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-4ae08b4d-4fed-4fe7-a968-88d2e3a61049 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 21:11:27.464458 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4ae08b4d-4fed-4fe7-a968-88d2e3a61049 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:27.464939 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4ae08b4d-4fed-4fe7-a968-88d2e3a61049 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:27.465371 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4ae08b4d-4fed-4fe7-a968-88d2e3a61049 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:27.466144 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4ae08b4d-4fed-4fe7-a968-88d2e3a61049 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:27.466603 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4ae08b4d-4fed-4fe7-a968-88d2e3a61049 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:27.467025 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4ae08b4d-4fed-4fe7-a968-88d2e3a61049 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:27.490614 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-4ae08b4d-4fed-4fe7-a968-88d2e3a61049 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Getting quotas for project cf734543b7e0426d93654f18f0d98e4a. Resources: {'cores', 'ram', 'instances'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:11:27.502207 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-4ae08b4d-4fed-4fe7-a968-88d2e3a61049 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Getting quotas for user 90472736cbcf497c89f0ae1582bb5ab0 and project cf734543b7e0426d93654f18f0d98e4a. Resources: {'cores', 'ram', 'instances'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:11:27.525141 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-4ae08b4d-4fed-4fe7-a968-88d2e3a61049 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Going to run 1 instances... {{(pid=120876) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 21:11:27.529361 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-4ae08b4d-4fed-4fe7-a968-88d2e3a61049 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bafb30c9-8108-4431-8132-2b2ca0efcfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 21:11:27.615652 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4ae08b4d-4fed-4fe7-a968-88d2e3a61049 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [e5e8f374-fe5f-4859-8fe5-41a593e36e98] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 19 21:11:27.660801 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-411dbfa1-303e-43a5-9aad-64def6918181 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:27.661515 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-411dbfa1-303e-43a5-9aad-64def6918181 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:27.668694 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-411dbfa1-303e-43a5-9aad-64def6918181 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:27.669264 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-411dbfa1-303e-43a5-9aad-64def6918181 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:27.669922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-411dbfa1-303e-43a5-9aad-64def6918181 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:27.670745 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-411dbfa1-303e-43a5-9aad-64def6918181 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:27.671265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-411dbfa1-303e-43a5-9aad-64def6918181 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:27.671718 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-411dbfa1-303e-43a5-9aad-64def6918181 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:27.841963 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-411dbfa1-303e-43a5-9aad-64def6918181 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:27.855206 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-411dbfa1-303e-43a5-9aad-64def6918181 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.201016 Aug 19 21:11:27.856257 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 172/313] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:27 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:28.626589 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO oslo.messaging._drivers.impl_rabbit [None req-4ae08b4d-4fed-4fe7-a968-88d2e3a61049 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [e5e8f374-fe5f-4859-8fe5-41a593e36e98] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56634. Aug 19 21:11:28.636575 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-4ae08b4d-4fed-4fe7-a968-88d2e3a61049 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.802357 Aug 19 21:11:28.638294 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 142/314] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Aug 19 21:11:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 21:11:28.659418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-54ab70b4-b9b1-4c76-8a9c-33966554b6de tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:28.661979 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-54ab70b4-b9b1-4c76-8a9c-33966554b6de tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:28.806436 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-54ab70b4-b9b1-4c76-8a9c-33966554b6de tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:28.814258 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-54ab70b4-b9b1-4c76-8a9c-33966554b6de tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1259 microversion: 2.1 time: 0.163247 Aug 19 21:11:28.815437 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 173/315] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:28 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:28.891665 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-4358f400-2cd9-42fd-ab6b-8a92bf4a7947 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:28.892446 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-4358f400-2cd9-42fd-ab6b-8a92bf4a7947 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:28.899774 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4358f400-2cd9-42fd-ab6b-8a92bf4a7947 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:28.900416 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4358f400-2cd9-42fd-ab6b-8a92bf4a7947 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:28.900847 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4358f400-2cd9-42fd-ab6b-8a92bf4a7947 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:28.901553 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4358f400-2cd9-42fd-ab6b-8a92bf4a7947 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:28.902030 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4358f400-2cd9-42fd-ab6b-8a92bf4a7947 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:28.902449 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4358f400-2cd9-42fd-ab6b-8a92bf4a7947 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:29.173652 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-4358f400-2cd9-42fd-ab6b-8a92bf4a7947 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:29.184885 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-4358f400-2cd9-42fd-ab6b-8a92bf4a7947 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.296942 Aug 19 21:11:29.185877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 143/316] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:28 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:29.848885 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0444afca-094c-408e-a5d8-9eca8e899575 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:29.850412 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0444afca-094c-408e-a5d8-9eca8e899575 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:29.851655 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=2 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:29.859088 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0444afca-094c-408e-a5d8-9eca8e899575 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:29.859716 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0444afca-094c-408e-a5d8-9eca8e899575 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:29.860234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0444afca-094c-408e-a5d8-9eca8e899575 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:29.861161 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0444afca-094c-408e-a5d8-9eca8e899575 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:29.861906 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0444afca-094c-408e-a5d8-9eca8e899575 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:29.862414 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0444afca-094c-408e-a5d8-9eca8e899575 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:29.865613 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=62 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:29.999848 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0444afca-094c-408e-a5d8-9eca8e899575 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:30.014533 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0444afca-094c-408e-a5d8-9eca8e899575 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1319 microversion: 2.1 time: 0.169586 Aug 19 21:11:30.015198 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 174/317] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:29 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:11:30.207480 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-6a8078ad-6637-4dc7-b89e-71f748004584 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:30.208204 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-6a8078ad-6637-4dc7-b89e-71f748004584 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:30.215341 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6a8078ad-6637-4dc7-b89e-71f748004584 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:30.215836 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6a8078ad-6637-4dc7-b89e-71f748004584 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:30.216458 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6a8078ad-6637-4dc7-b89e-71f748004584 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:30.217357 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6a8078ad-6637-4dc7-b89e-71f748004584 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:30.218018 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6a8078ad-6637-4dc7-b89e-71f748004584 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:30.218631 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6a8078ad-6637-4dc7-b89e-71f748004584 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:30.885918 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-6a8078ad-6637-4dc7-b89e-71f748004584 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:30.901594 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-6a8078ad-6637-4dc7-b89e-71f748004584 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.698416 Aug 19 21:11:30.917945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 144/318] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:30 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:31.047516 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-532077c3-712a-4296-a259-078d6e1c5f54 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:31.050486 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-532077c3-712a-4296-a259-078d6e1c5f54 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:31.058105 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-532077c3-712a-4296-a259-078d6e1c5f54 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:31.059391 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-532077c3-712a-4296-a259-078d6e1c5f54 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:31.061383 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-532077c3-712a-4296-a259-078d6e1c5f54 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:31.064824 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-532077c3-712a-4296-a259-078d6e1c5f54 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:31.066643 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-532077c3-712a-4296-a259-078d6e1c5f54 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:31.067349 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-532077c3-712a-4296-a259-078d6e1c5f54 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:31.196031 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-532077c3-712a-4296-a259-078d6e1c5f54 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:31.207187 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-532077c3-712a-4296-a259-078d6e1c5f54 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1317 microversion: 2.1 time: 0.167339 Aug 19 21:11:31.207782 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 175/319] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:31 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:31.928479 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-e332cce4-f2c4-4a4a-a522-a43e2ac11b19 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:31.929344 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-e332cce4-f2c4-4a4a-a522-a43e2ac11b19 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:31.949523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e332cce4-f2c4-4a4a-a522-a43e2ac11b19 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:31.950546 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e332cce4-f2c4-4a4a-a522-a43e2ac11b19 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:31.951097 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e332cce4-f2c4-4a4a-a522-a43e2ac11b19 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:31.951937 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e332cce4-f2c4-4a4a-a522-a43e2ac11b19 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:31.952520 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e332cce4-f2c4-4a4a-a522-a43e2ac11b19 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:31.954070 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e332cce4-f2c4-4a4a-a522-a43e2ac11b19 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:32.139342 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-e332cce4-f2c4-4a4a-a522-a43e2ac11b19 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:32.148423 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-e332cce4-f2c4-4a4a-a522-a43e2ac11b19 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.224513 Aug 19 21:11:32.149009 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 145/320] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:31 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:11:32.230188 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-78ee4cbd-2bca-43d3-8be7-d1bb2affba82 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:32.230955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-78ee4cbd-2bca-43d3-8be7-d1bb2affba82 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:32.238648 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-78ee4cbd-2bca-43d3-8be7-d1bb2affba82 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:32.239523 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-78ee4cbd-2bca-43d3-8be7-d1bb2affba82 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:32.239897 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-78ee4cbd-2bca-43d3-8be7-d1bb2affba82 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:32.240657 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-78ee4cbd-2bca-43d3-8be7-d1bb2affba82 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:32.241126 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-78ee4cbd-2bca-43d3-8be7-d1bb2affba82 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:32.241553 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-78ee4cbd-2bca-43d3-8be7-d1bb2affba82 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:32.415620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-78ee4cbd-2bca-43d3-8be7-d1bb2affba82 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:32.445937 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-78ee4cbd-2bca-43d3-8be7-d1bb2affba82 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.208369 Aug 19 21:11:32.449851 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 176/321] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:32 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:33.169508 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-06af0759-dedf-4cd8-8aed-b19c6b104dd8 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:33.170189 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-06af0759-dedf-4cd8-8aed-b19c6b104dd8 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:33.178190 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-06af0759-dedf-4cd8-8aed-b19c6b104dd8 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:33.178872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-06af0759-dedf-4cd8-8aed-b19c6b104dd8 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:33.179395 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-06af0759-dedf-4cd8-8aed-b19c6b104dd8 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:33.180196 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-06af0759-dedf-4cd8-8aed-b19c6b104dd8 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:33.180796 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-06af0759-dedf-4cd8-8aed-b19c6b104dd8 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:33.181302 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-06af0759-dedf-4cd8-8aed-b19c6b104dd8 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:33.376461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-06af0759-dedf-4cd8-8aed-b19c6b104dd8 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:33.386498 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-06af0759-dedf-4cd8-8aed-b19c6b104dd8 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.221016 Aug 19 21:11:33.387110 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 146/322] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:33 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:33.470255 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-1dd8734c-9465-4ee9-b359-caf411bbb7d6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:33.472314 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-1dd8734c-9465-4ee9-b359-caf411bbb7d6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:33.482695 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1dd8734c-9465-4ee9-b359-caf411bbb7d6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:33.483506 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1dd8734c-9465-4ee9-b359-caf411bbb7d6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:33.484743 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1dd8734c-9465-4ee9-b359-caf411bbb7d6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:33.486604 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1dd8734c-9465-4ee9-b359-caf411bbb7d6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:33.487170 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1dd8734c-9465-4ee9-b359-caf411bbb7d6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:33.489134 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1dd8734c-9465-4ee9-b359-caf411bbb7d6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:33.521117 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-2639cfb5-9824-46cc-8e06-84e958f5896d req-f2dd70a2-8e09-4a76-af2b-e654b3123f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345e628f-70ab-410e-8b94-06ca1343492e", "name": "network-vif-plugged", "status": "completed", "tag": "d27c6406-4abb-4095-ad1e-f0db5b6e3763"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:11:33.541037 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-2639cfb5-9824-46cc-8e06-84e958f5896d req-f2dd70a2-8e09-4a76-af2b-e654b3123f14 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:33.541604 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-2639cfb5-9824-46cc-8e06-84e958f5896d req-f2dd70a2-8e09-4a76-af2b-e654b3123f14 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:33.542083 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-2639cfb5-9824-46cc-8e06-84e958f5896d req-f2dd70a2-8e09-4a76-af2b-e654b3123f14 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:33.585033 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-2639cfb5-9824-46cc-8e06-84e958f5896d req-f2dd70a2-8e09-4a76-af2b-e654b3123f14 service nova] Creating event network-vif-plugged:d27c6406-4abb-4095-ad1e-f0db5b6e3763 for instance 345e628f-70ab-410e-8b94-06ca1343492e on hv-cinder-85220 Aug 19 21:11:33.591676 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-2639cfb5-9824-46cc-8e06-84e958f5896d req-f2dd70a2-8e09-4a76-af2b-e654b3123f14 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082220 Aug 19 21:11:33.592286 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 147/323] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:11:33.748856 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-1dd8734c-9465-4ee9-b359-caf411bbb7d6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:33.760262 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-1dd8734c-9465-4ee9-b359-caf411bbb7d6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.295895 Aug 19 21:11:33.760877 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 177/324] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:33 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:34.421188 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d8412d01-8122-44b5-80a3-7c7d72fefa4e tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:34.423602 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-d8412d01-8122-44b5-80a3-7c7d72fefa4e tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:34.445314 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d8412d01-8122-44b5-80a3-7c7d72fefa4e tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:34.447074 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d8412d01-8122-44b5-80a3-7c7d72fefa4e tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:34.447997 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d8412d01-8122-44b5-80a3-7c7d72fefa4e tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:34.449801 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d8412d01-8122-44b5-80a3-7c7d72fefa4e tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:34.450959 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d8412d01-8122-44b5-80a3-7c7d72fefa4e tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:34.452022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d8412d01-8122-44b5-80a3-7c7d72fefa4e tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:34.707568 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-d8412d01-8122-44b5-80a3-7c7d72fefa4e tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:34.715819 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-d8412d01-8122-44b5-80a3-7c7d72fefa4e tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.309402 Aug 19 21:11:34.716393 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 148/325] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:34 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:34.786119 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-b3050530-293a-49bc-95cc-2d82266f1f00 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:34.787368 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-b3050530-293a-49bc-95cc-2d82266f1f00 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:34.797338 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b3050530-293a-49bc-95cc-2d82266f1f00 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:34.798185 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b3050530-293a-49bc-95cc-2d82266f1f00 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:34.798625 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b3050530-293a-49bc-95cc-2d82266f1f00 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:34.799993 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b3050530-293a-49bc-95cc-2d82266f1f00 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:34.800641 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b3050530-293a-49bc-95cc-2d82266f1f00 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:34.801100 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b3050530-293a-49bc-95cc-2d82266f1f00 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:34.968140 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-b3050530-293a-49bc-95cc-2d82266f1f00 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:34.984724 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-b3050530-293a-49bc-95cc-2d82266f1f00 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.205681 Aug 19 21:11:35.000383 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 178/326] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:34 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:35.737937 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d1133738-0a60-48a4-ba77-9cce0480f89d tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:35.738603 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-d1133738-0a60-48a4-ba77-9cce0480f89d tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:35.745489 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d1133738-0a60-48a4-ba77-9cce0480f89d tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:35.746026 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d1133738-0a60-48a4-ba77-9cce0480f89d tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:35.746466 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d1133738-0a60-48a4-ba77-9cce0480f89d tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:35.747182 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d1133738-0a60-48a4-ba77-9cce0480f89d tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:35.747641 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d1133738-0a60-48a4-ba77-9cce0480f89d tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:35.748067 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d1133738-0a60-48a4-ba77-9cce0480f89d tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:35.922509 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-d1133738-0a60-48a4-ba77-9cce0480f89d tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:35.938723 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-d1133738-0a60-48a4-ba77-9cce0480f89d tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.205397 Aug 19 21:11:35.953572 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 149/327] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:35 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:36.007726 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0e0a085a-cbbd-4f72-a602-06d2f21e7946 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:36.008468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0e0a085a-cbbd-4f72-a602-06d2f21e7946 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:36.014927 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0e0a085a-cbbd-4f72-a602-06d2f21e7946 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:36.015423 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0e0a085a-cbbd-4f72-a602-06d2f21e7946 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:36.015961 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0e0a085a-cbbd-4f72-a602-06d2f21e7946 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:36.016669 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0e0a085a-cbbd-4f72-a602-06d2f21e7946 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:36.017129 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0e0a085a-cbbd-4f72-a602-06d2f21e7946 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:36.017554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0e0a085a-cbbd-4f72-a602-06d2f21e7946 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:36.207718 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0e0a085a-cbbd-4f72-a602-06d2f21e7946 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:36.227136 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0e0a085a-cbbd-4f72-a602-06d2f21e7946 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.223455 Aug 19 21:11:36.227930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 179/328] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:36 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:36.965993 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-ceb9e842-a6fa-46f0-b138-560c05780e3f tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:36.966909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-ceb9e842-a6fa-46f0-b138-560c05780e3f tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:36.973744 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ceb9e842-a6fa-46f0-b138-560c05780e3f tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:36.974278 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ceb9e842-a6fa-46f0-b138-560c05780e3f tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:36.974714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ceb9e842-a6fa-46f0-b138-560c05780e3f tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:36.975420 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ceb9e842-a6fa-46f0-b138-560c05780e3f tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:36.975882 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ceb9e842-a6fa-46f0-b138-560c05780e3f tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:36.976304 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ceb9e842-a6fa-46f0-b138-560c05780e3f tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:36.979371 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=74 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:37.146476 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-ceb9e842-a6fa-46f0-b138-560c05780e3f tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:37.154605 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-ceb9e842-a6fa-46f0-b138-560c05780e3f tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.193498 Aug 19 21:11:37.155173 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 150/329] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:36 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:37.254413 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e3fec7a1-2cb2-4e61-a6c8-6d3b642655ae tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:37.255038 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-e3fec7a1-2cb2-4e61-a6c8-6d3b642655ae tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:37.261434 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e3fec7a1-2cb2-4e61-a6c8-6d3b642655ae tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:37.262029 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e3fec7a1-2cb2-4e61-a6c8-6d3b642655ae tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:37.262486 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e3fec7a1-2cb2-4e61-a6c8-6d3b642655ae tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:37.263178 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e3fec7a1-2cb2-4e61-a6c8-6d3b642655ae tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:37.263625 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e3fec7a1-2cb2-4e61-a6c8-6d3b642655ae tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:37.264040 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e3fec7a1-2cb2-4e61-a6c8-6d3b642655ae tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:37.431734 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e3fec7a1-2cb2-4e61-a6c8-6d3b642655ae tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:37.443076 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e3fec7a1-2cb2-4e61-a6c8-6d3b642655ae tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.193081 Aug 19 21:11:37.444189 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 180/330] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:37 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:38.176630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-b7e71c96-0349-46b9-a463-5d3c7e8da8f0 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:38.177252 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-b7e71c96-0349-46b9-a463-5d3c7e8da8f0 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:38.179146 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=2 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:38.179806 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=8 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:38.186054 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b7e71c96-0349-46b9-a463-5d3c7e8da8f0 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:38.186532 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b7e71c96-0349-46b9-a463-5d3c7e8da8f0 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:38.186960 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b7e71c96-0349-46b9-a463-5d3c7e8da8f0 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:38.187651 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b7e71c96-0349-46b9-a463-5d3c7e8da8f0 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:38.188094 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b7e71c96-0349-46b9-a463-5d3c7e8da8f0 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:38.188580 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b7e71c96-0349-46b9-a463-5d3c7e8da8f0 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:38.351544 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b7e71c96-0349-46b9-a463-5d3c7e8da8f0 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:38.364351 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-b7e71c96-0349-46b9-a463-5d3c7e8da8f0 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.192267 Aug 19 21:11:38.365484 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 151/331] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:38 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:38.464834 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0b0170ef-e31c-47fa-a763-82f46c117de6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:38.466190 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0b0170ef-e31c-47fa-a763-82f46c117de6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:38.468392 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:38.476548 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0b0170ef-e31c-47fa-a763-82f46c117de6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:38.477170 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0b0170ef-e31c-47fa-a763-82f46c117de6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:38.477687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0b0170ef-e31c-47fa-a763-82f46c117de6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:38.478501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0b0170ef-e31c-47fa-a763-82f46c117de6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:38.478939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0b0170ef-e31c-47fa-a763-82f46c117de6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:38.479367 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0b0170ef-e31c-47fa-a763-82f46c117de6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:38.637264 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0b0170ef-e31c-47fa-a763-82f46c117de6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:38.647894 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0b0170ef-e31c-47fa-a763-82f46c117de6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.186935 Aug 19 21:11:38.648487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 181/332] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:38 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:39.386075 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-539d5ade-ce7b-42ce-b5f0-8ee8870b80a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:39.386724 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-539d5ade-ce7b-42ce-b5f0-8ee8870b80a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:39.396072 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-539d5ade-ce7b-42ce-b5f0-8ee8870b80a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:39.396554 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-539d5ade-ce7b-42ce-b5f0-8ee8870b80a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:39.396982 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-539d5ade-ce7b-42ce-b5f0-8ee8870b80a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:39.397694 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-539d5ade-ce7b-42ce-b5f0-8ee8870b80a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:39.398187 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-539d5ade-ce7b-42ce-b5f0-8ee8870b80a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:39.398611 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-539d5ade-ce7b-42ce-b5f0-8ee8870b80a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:39.570532 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-539d5ade-ce7b-42ce-b5f0-8ee8870b80a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:39.579597 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-539d5ade-ce7b-42ce-b5f0-8ee8870b80a5 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.198062 Aug 19 21:11:39.580174 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 152/333] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:39 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:39.668370 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-246a0860-3603-45da-96e8-1cbb96cf0d10 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:39.668991 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-246a0860-3603-45da-96e8-1cbb96cf0d10 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:39.670850 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=12 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:39.676187 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-246a0860-3603-45da-96e8-1cbb96cf0d10 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:39.676669 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-246a0860-3603-45da-96e8-1cbb96cf0d10 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:39.677108 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-246a0860-3603-45da-96e8-1cbb96cf0d10 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:39.677828 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-246a0860-3603-45da-96e8-1cbb96cf0d10 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:39.678284 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-246a0860-3603-45da-96e8-1cbb96cf0d10 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:39.678707 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-246a0860-3603-45da-96e8-1cbb96cf0d10 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:39.824545 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-246a0860-3603-45da-96e8-1cbb96cf0d10 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:39.833040 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-246a0860-3603-45da-96e8-1cbb96cf0d10 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.168300 Aug 19 21:11:39.833633 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 182/334] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:39 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:40.601387 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-cefaa03a-bfbd-4ebf-a500-869e96e365f4 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:40.602043 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-cefaa03a-bfbd-4ebf-a500-869e96e365f4 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:40.608619 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cefaa03a-bfbd-4ebf-a500-869e96e365f4 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:40.609108 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cefaa03a-bfbd-4ebf-a500-869e96e365f4 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:40.609538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cefaa03a-bfbd-4ebf-a500-869e96e365f4 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:40.610273 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cefaa03a-bfbd-4ebf-a500-869e96e365f4 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:40.610729 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cefaa03a-bfbd-4ebf-a500-869e96e365f4 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:40.611152 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cefaa03a-bfbd-4ebf-a500-869e96e365f4 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:40.768953 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-cefaa03a-bfbd-4ebf-a500-869e96e365f4 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:40.777799 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-cefaa03a-bfbd-4ebf-a500-869e96e365f4 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.180168 Aug 19 21:11:40.778660 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 153/335] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:40 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:40.855073 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-f39b5b0b-41dd-40c0-850b-c7323127487e tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:40.855829 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-f39b5b0b-41dd-40c0-850b-c7323127487e tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:40.864451 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f39b5b0b-41dd-40c0-850b-c7323127487e tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:40.864451 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f39b5b0b-41dd-40c0-850b-c7323127487e tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:40.864769 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f39b5b0b-41dd-40c0-850b-c7323127487e tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:40.865279 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f39b5b0b-41dd-40c0-850b-c7323127487e tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:40.865980 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f39b5b0b-41dd-40c0-850b-c7323127487e tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:40.866503 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f39b5b0b-41dd-40c0-850b-c7323127487e tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:41.013596 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-f39b5b0b-41dd-40c0-850b-c7323127487e tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:41.024750 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-f39b5b0b-41dd-40c0-850b-c7323127487e tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.173632 Aug 19 21:11:41.026067 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 183/336] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:40 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:41.800861 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-6f715221-7be2-4ddc-8f58-35e1a6805b06 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:41.801806 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-6f715221-7be2-4ddc-8f58-35e1a6805b06 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:41.808480 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6f715221-7be2-4ddc-8f58-35e1a6805b06 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:41.809100 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6f715221-7be2-4ddc-8f58-35e1a6805b06 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:41.809614 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6f715221-7be2-4ddc-8f58-35e1a6805b06 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:41.810434 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6f715221-7be2-4ddc-8f58-35e1a6805b06 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:41.811180 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6f715221-7be2-4ddc-8f58-35e1a6805b06 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:41.812678 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6f715221-7be2-4ddc-8f58-35e1a6805b06 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:41.971972 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-6f715221-7be2-4ddc-8f58-35e1a6805b06 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:41.980970 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-6f715221-7be2-4ddc-8f58-35e1a6805b06 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.184557 Aug 19 21:11:41.981617 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 154/337] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:41 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:42.046994 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-676c1a11-f88b-47d6-8f5b-8e3146a37ebd tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:42.047703 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-676c1a11-f88b-47d6-8f5b-8e3146a37ebd tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:42.055059 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-676c1a11-f88b-47d6-8f5b-8e3146a37ebd tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:42.055548 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-676c1a11-f88b-47d6-8f5b-8e3146a37ebd tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:42.055977 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-676c1a11-f88b-47d6-8f5b-8e3146a37ebd tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:42.056675 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-676c1a11-f88b-47d6-8f5b-8e3146a37ebd tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:42.057124 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-676c1a11-f88b-47d6-8f5b-8e3146a37ebd tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:42.057538 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-676c1a11-f88b-47d6-8f5b-8e3146a37ebd tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:42.246264 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-676c1a11-f88b-47d6-8f5b-8e3146a37ebd tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:42.263605 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-676c1a11-f88b-47d6-8f5b-8e3146a37ebd tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.221311 Aug 19 21:11:42.278035 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 184/338] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:42 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:43.003703 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-c9776be0-5c12-4de7-b852-9dd3862fae34 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:43.004572 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-c9776be0-5c12-4de7-b852-9dd3862fae34 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:43.011728 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c9776be0-5c12-4de7-b852-9dd3862fae34 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:43.012216 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c9776be0-5c12-4de7-b852-9dd3862fae34 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:43.012642 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c9776be0-5c12-4de7-b852-9dd3862fae34 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:43.013340 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c9776be0-5c12-4de7-b852-9dd3862fae34 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:43.013996 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c9776be0-5c12-4de7-b852-9dd3862fae34 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:43.014413 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c9776be0-5c12-4de7-b852-9dd3862fae34 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:43.168532 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-c9776be0-5c12-4de7-b852-9dd3862fae34 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:43.178750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-c9776be0-5c12-4de7-b852-9dd3862fae34 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.179574 Aug 19 21:11:43.179515 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 155/339] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:42 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:43.301580 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-feb7440b-fb91-429f-89ca-8a47139f5def tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:43.303762 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-feb7440b-fb91-429f-89ca-8a47139f5def tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:43.311687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-feb7440b-fb91-429f-89ca-8a47139f5def tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:43.312485 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-feb7440b-fb91-429f-89ca-8a47139f5def tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:43.313105 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-feb7440b-fb91-429f-89ca-8a47139f5def tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:43.314775 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-feb7440b-fb91-429f-89ca-8a47139f5def tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:43.315527 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-feb7440b-fb91-429f-89ca-8a47139f5def tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:43.316167 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-feb7440b-fb91-429f-89ca-8a47139f5def tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:43.470435 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-feb7440b-fb91-429f-89ca-8a47139f5def tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:43.479572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-feb7440b-fb91-429f-89ca-8a47139f5def tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.185829 Aug 19 21:11:43.480179 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 185/340] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:43 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:44.200575 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-dc557151-21be-4f17-84ca-94dc05cc2309 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:44.201186 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-dc557151-21be-4f17-84ca-94dc05cc2309 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:44.208399 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dc557151-21be-4f17-84ca-94dc05cc2309 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:44.208885 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dc557151-21be-4f17-84ca-94dc05cc2309 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:44.209317 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dc557151-21be-4f17-84ca-94dc05cc2309 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:44.210044 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dc557151-21be-4f17-84ca-94dc05cc2309 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:44.210632 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dc557151-21be-4f17-84ca-94dc05cc2309 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:44.211394 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dc557151-21be-4f17-84ca-94dc05cc2309 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:44.348950 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-dc557151-21be-4f17-84ca-94dc05cc2309 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:44.356615 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-dc557151-21be-4f17-84ca-94dc05cc2309 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.159954 Aug 19 21:11:44.357169 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 156/341] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:44 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:44.501118 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0463f588-aed0-4160-b78b-40190b2db99b tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:44.501779 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0463f588-aed0-4160-b78b-40190b2db99b tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:44.508867 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0463f588-aed0-4160-b78b-40190b2db99b tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:44.509354 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0463f588-aed0-4160-b78b-40190b2db99b tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:44.510091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0463f588-aed0-4160-b78b-40190b2db99b tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:44.510902 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0463f588-aed0-4160-b78b-40190b2db99b tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:44.511361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0463f588-aed0-4160-b78b-40190b2db99b tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:44.512028 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0463f588-aed0-4160-b78b-40190b2db99b tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:44.647022 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0463f588-aed0-4160-b78b-40190b2db99b tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:44.654611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0463f588-aed0-4160-b78b-40190b2db99b tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.157328 Aug 19 21:11:44.655166 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 186/342] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:44 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:45.379142 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-bb31ba52-915a-4d8c-b9a7-85087f7246a6 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:45.379739 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-bb31ba52-915a-4d8c-b9a7-85087f7246a6 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:45.386181 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-bb31ba52-915a-4d8c-b9a7-85087f7246a6 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:45.386654 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-bb31ba52-915a-4d8c-b9a7-85087f7246a6 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:45.387084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-bb31ba52-915a-4d8c-b9a7-85087f7246a6 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:45.387754 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-bb31ba52-915a-4d8c-b9a7-85087f7246a6 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:45.388201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-bb31ba52-915a-4d8c-b9a7-85087f7246a6 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:45.388614 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-bb31ba52-915a-4d8c-b9a7-85087f7246a6 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:45.525032 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-bb31ba52-915a-4d8c-b9a7-85087f7246a6 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:45.532916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-bb31ba52-915a-4d8c-b9a7-85087f7246a6 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.158884 Aug 19 21:11:45.533486 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 157/343] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:45 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:45.675724 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-f536683b-7c1e-4dda-9486-c76145921d69 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:45.676958 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-f536683b-7c1e-4dda-9486-c76145921d69 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:45.682808 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f536683b-7c1e-4dda-9486-c76145921d69 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:45.683291 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f536683b-7c1e-4dda-9486-c76145921d69 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:45.683723 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f536683b-7c1e-4dda-9486-c76145921d69 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:45.684402 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f536683b-7c1e-4dda-9486-c76145921d69 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:45.684853 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f536683b-7c1e-4dda-9486-c76145921d69 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:45.685270 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f536683b-7c1e-4dda-9486-c76145921d69 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:45.816151 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-f536683b-7c1e-4dda-9486-c76145921d69 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:45.824240 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-f536683b-7c1e-4dda-9486-c76145921d69 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.152344 Aug 19 21:11:45.825042 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 187/344] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:45 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:46.555918 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-da94a4ae-9676-42f0-8381-2fb9c957c771 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:46.556525 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-da94a4ae-9676-42f0-8381-2fb9c957c771 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:46.563124 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-da94a4ae-9676-42f0-8381-2fb9c957c771 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:46.563603 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-da94a4ae-9676-42f0-8381-2fb9c957c771 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:46.564035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-da94a4ae-9676-42f0-8381-2fb9c957c771 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:46.564726 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-da94a4ae-9676-42f0-8381-2fb9c957c771 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:46.565179 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-da94a4ae-9676-42f0-8381-2fb9c957c771 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:46.565599 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-da94a4ae-9676-42f0-8381-2fb9c957c771 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:46.697265 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-da94a4ae-9676-42f0-8381-2fb9c957c771 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:46.705299 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-da94a4ae-9676-42f0-8381-2fb9c957c771 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.153611 Aug 19 21:11:46.705885 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 158/345] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:46 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:46.846085 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-89db9392-5bbc-4b5b-8a0d-03bbd8e347b9 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:46.846751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-89db9392-5bbc-4b5b-8a0d-03bbd8e347b9 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:46.855592 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-89db9392-5bbc-4b5b-8a0d-03bbd8e347b9 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:46.856082 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-89db9392-5bbc-4b5b-8a0d-03bbd8e347b9 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:46.856515 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-89db9392-5bbc-4b5b-8a0d-03bbd8e347b9 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:46.857244 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-89db9392-5bbc-4b5b-8a0d-03bbd8e347b9 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:46.857701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-89db9392-5bbc-4b5b-8a0d-03bbd8e347b9 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:46.858146 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-89db9392-5bbc-4b5b-8a0d-03bbd8e347b9 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:46.995019 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-89db9392-5bbc-4b5b-8a0d-03bbd8e347b9 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:47.002742 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-89db9392-5bbc-4b5b-8a0d-03bbd8e347b9 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.161348 Aug 19 21:11:47.003310 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 188/346] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:46 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:47.727922 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-a7c38247-3a09-4f22-af8a-03a754f3e581 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:47.728485 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-a7c38247-3a09-4f22-af8a-03a754f3e581 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:47.734863 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a7c38247-3a09-4f22-af8a-03a754f3e581 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:47.735343 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a7c38247-3a09-4f22-af8a-03a754f3e581 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:47.735773 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a7c38247-3a09-4f22-af8a-03a754f3e581 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:47.736448 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a7c38247-3a09-4f22-af8a-03a754f3e581 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:47.736910 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a7c38247-3a09-4f22-af8a-03a754f3e581 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:47.737311 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a7c38247-3a09-4f22-af8a-03a754f3e581 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:47.879971 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-a7c38247-3a09-4f22-af8a-03a754f3e581 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:47.888418 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-a7c38247-3a09-4f22-af8a-03a754f3e581 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.164435 Aug 19 21:11:47.889057 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 159/347] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:47 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:48.024322 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a3d56327-c171-4dae-bb49-57df02680995 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:48.024927 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-a3d56327-c171-4dae-bb49-57df02680995 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:48.032110 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3d56327-c171-4dae-bb49-57df02680995 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:48.032498 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3d56327-c171-4dae-bb49-57df02680995 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:48.032931 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3d56327-c171-4dae-bb49-57df02680995 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:48.033620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3d56327-c171-4dae-bb49-57df02680995 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:48.034106 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3d56327-c171-4dae-bb49-57df02680995 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:48.034521 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3d56327-c171-4dae-bb49-57df02680995 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:48.168158 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-a3d56327-c171-4dae-bb49-57df02680995 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:48.175691 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-a3d56327-c171-4dae-bb49-57df02680995 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.155402 Aug 19 21:11:48.176271 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 189/348] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:48 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:48.909687 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-506e14be-bdba-4256-98f2-4a04a857d90c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:48.910328 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-506e14be-bdba-4256-98f2-4a04a857d90c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:48.918316 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-506e14be-bdba-4256-98f2-4a04a857d90c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:48.918792 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-506e14be-bdba-4256-98f2-4a04a857d90c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:48.919260 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-506e14be-bdba-4256-98f2-4a04a857d90c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:48.919953 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-506e14be-bdba-4256-98f2-4a04a857d90c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:48.920401 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-506e14be-bdba-4256-98f2-4a04a857d90c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:48.920817 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-506e14be-bdba-4256-98f2-4a04a857d90c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:49.066097 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-506e14be-bdba-4256-98f2-4a04a857d90c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:49.076136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-506e14be-bdba-4256-98f2-4a04a857d90c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.169444 Aug 19 21:11:49.076991 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 160/349] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:48 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:49.198626 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-da13e867-4393-47ea-9a56-742f18743648 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:49.199167 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-da13e867-4393-47ea-9a56-742f18743648 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:49.205201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-da13e867-4393-47ea-9a56-742f18743648 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:49.205685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-da13e867-4393-47ea-9a56-742f18743648 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:49.206154 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-da13e867-4393-47ea-9a56-742f18743648 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:49.207037 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-da13e867-4393-47ea-9a56-742f18743648 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:49.207513 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-da13e867-4393-47ea-9a56-742f18743648 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:49.208613 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-da13e867-4393-47ea-9a56-742f18743648 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:49.344374 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-da13e867-4393-47ea-9a56-742f18743648 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:49.344374 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=100 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:49.354171 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-da13e867-4393-47ea-9a56-742f18743648 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.159399 Aug 19 21:11:49.355078 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 190/350] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:49 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:50.105015 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-fd87eb4a-94b0-440e-bafc-0fbee0432794 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:50.105616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-fd87eb4a-94b0-440e-bafc-0fbee0432794 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:50.112136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fd87eb4a-94b0-440e-bafc-0fbee0432794 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:50.112615 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fd87eb4a-94b0-440e-bafc-0fbee0432794 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:50.113051 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fd87eb4a-94b0-440e-bafc-0fbee0432794 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:50.113737 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fd87eb4a-94b0-440e-bafc-0fbee0432794 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:50.114778 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fd87eb4a-94b0-440e-bafc-0fbee0432794 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:50.115208 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fd87eb4a-94b0-440e-bafc-0fbee0432794 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:50.251188 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-fd87eb4a-94b0-440e-bafc-0fbee0432794 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:50.260236 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-fd87eb4a-94b0-440e-bafc-0fbee0432794 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.158962 Aug 19 21:11:50.260736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 161/351] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:50 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:50.375930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-7eb1691a-0a24-447d-9c4b-7349f18915ea tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:50.376550 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-7eb1691a-0a24-447d-9c4b-7349f18915ea tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:50.383607 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7eb1691a-0a24-447d-9c4b-7349f18915ea tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:50.384092 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7eb1691a-0a24-447d-9c4b-7349f18915ea tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:50.384521 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7eb1691a-0a24-447d-9c4b-7349f18915ea tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:50.385217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7eb1691a-0a24-447d-9c4b-7349f18915ea tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:50.385670 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7eb1691a-0a24-447d-9c4b-7349f18915ea tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:50.386127 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7eb1691a-0a24-447d-9c4b-7349f18915ea tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:50.518918 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-7eb1691a-0a24-447d-9c4b-7349f18915ea tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:50.526643 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-7eb1691a-0a24-447d-9c4b-7349f18915ea tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.154620 Aug 19 21:11:50.527201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 191/352] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:50 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:51.280508 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-6be242c2-48c8-405c-bf9f-f7cb45b94f4a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:51.281115 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-6be242c2-48c8-405c-bf9f-f7cb45b94f4a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:51.287791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6be242c2-48c8-405c-bf9f-f7cb45b94f4a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:51.288276 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6be242c2-48c8-405c-bf9f-f7cb45b94f4a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:51.288711 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6be242c2-48c8-405c-bf9f-f7cb45b94f4a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:51.289400 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6be242c2-48c8-405c-bf9f-f7cb45b94f4a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:51.289890 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6be242c2-48c8-405c-bf9f-f7cb45b94f4a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:51.290318 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6be242c2-48c8-405c-bf9f-f7cb45b94f4a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:51.423014 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-6be242c2-48c8-405c-bf9f-f7cb45b94f4a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:51.431507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-6be242c2-48c8-405c-bf9f-f7cb45b94f4a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.154907 Aug 19 21:11:51.432116 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 162/353] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:51 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:51.547299 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-5a11d9bc-66f7-4e2e-9533-f513246b5f10 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:51.547917 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-5a11d9bc-66f7-4e2e-9533-f513246b5f10 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:51.554824 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5a11d9bc-66f7-4e2e-9533-f513246b5f10 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:51.555314 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5a11d9bc-66f7-4e2e-9533-f513246b5f10 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:51.555753 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5a11d9bc-66f7-4e2e-9533-f513246b5f10 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:51.556468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5a11d9bc-66f7-4e2e-9533-f513246b5f10 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:51.556903 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5a11d9bc-66f7-4e2e-9533-f513246b5f10 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:51.557325 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5a11d9bc-66f7-4e2e-9533-f513246b5f10 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:51.687506 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-5a11d9bc-66f7-4e2e-9533-f513246b5f10 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:51.695323 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-5a11d9bc-66f7-4e2e-9533-f513246b5f10 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.151904 Aug 19 21:11:51.695890 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 192/354] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:51 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:52.452165 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-77b14b44-ab56-475a-a5d6-643cab3afb84 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:52.452699 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-77b14b44-ab56-475a-a5d6-643cab3afb84 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:52.454991 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:52.460459 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-77b14b44-ab56-475a-a5d6-643cab3afb84 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:52.460937 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-77b14b44-ab56-475a-a5d6-643cab3afb84 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:52.461368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-77b14b44-ab56-475a-a5d6-643cab3afb84 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:52.462083 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-77b14b44-ab56-475a-a5d6-643cab3afb84 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:52.462538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-77b14b44-ab56-475a-a5d6-643cab3afb84 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:52.462957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-77b14b44-ab56-475a-a5d6-643cab3afb84 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:52.602240 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-77b14b44-ab56-475a-a5d6-643cab3afb84 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:52.610208 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-77b14b44-ab56-475a-a5d6-643cab3afb84 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.161870 Aug 19 21:11:52.610791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 163/355] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:52 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:52.718632 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8f3aa764-93b5-4bc1-807c-a60cb55434bd tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:52.719231 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8f3aa764-93b5-4bc1-807c-a60cb55434bd tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:52.727510 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8f3aa764-93b5-4bc1-807c-a60cb55434bd tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:52.728432 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8f3aa764-93b5-4bc1-807c-a60cb55434bd tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:52.729057 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8f3aa764-93b5-4bc1-807c-a60cb55434bd tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:52.729909 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8f3aa764-93b5-4bc1-807c-a60cb55434bd tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:52.730377 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8f3aa764-93b5-4bc1-807c-a60cb55434bd tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:52.730795 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8f3aa764-93b5-4bc1-807c-a60cb55434bd tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:53.002763 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8f3aa764-93b5-4bc1-807c-a60cb55434bd tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:53.010954 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8f3aa764-93b5-4bc1-807c-a60cb55434bd tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.297244 Aug 19 21:11:53.011535 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 193/356] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:52 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:53.340602 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-eb71b024-d4c3-463e-a598-021365d9eb43 req-5c86bf74-8620-4638-9a15-404780bc2ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea09e576-f3ee-4b10-813f-23574635c10c", "tag": "dc06a7d7-d9fe-4dd6-8dab-d1c3f12f11f3"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:11:53.357155 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-eb71b024-d4c3-463e-a598-021365d9eb43 req-5c86bf74-8620-4638-9a15-404780bc2ac4 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:53.357655 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-eb71b024-d4c3-463e-a598-021365d9eb43 req-5c86bf74-8620-4638-9a15-404780bc2ac4 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:53.358118 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-eb71b024-d4c3-463e-a598-021365d9eb43 req-5c86bf74-8620-4638-9a15-404780bc2ac4 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:53.372246 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-eb71b024-d4c3-463e-a598-021365d9eb43 req-5c86bf74-8620-4638-9a15-404780bc2ac4 service nova] Creating event network-changed:dc06a7d7-d9fe-4dd6-8dab-d1c3f12f11f3 for instance ea09e576-f3ee-4b10-813f-23574635c10c on hv-cinder-85220 Aug 19 21:11:53.378230 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-eb71b024-d4c3-463e-a598-021365d9eb43 req-5c86bf74-8620-4638-9a15-404780bc2ac4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042315 Aug 19 21:11:53.380685 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 164/357] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:11:53.632759 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ba6f7312-0f01-4122-9a1c-a1be841bbb84 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:53.633539 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ba6f7312-0f01-4122-9a1c-a1be841bbb84 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:53.639512 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ba6f7312-0f01-4122-9a1c-a1be841bbb84 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:53.640000 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ba6f7312-0f01-4122-9a1c-a1be841bbb84 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:53.640435 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ba6f7312-0f01-4122-9a1c-a1be841bbb84 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:53.641155 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ba6f7312-0f01-4122-9a1c-a1be841bbb84 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:53.641611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ba6f7312-0f01-4122-9a1c-a1be841bbb84 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:53.642075 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ba6f7312-0f01-4122-9a1c-a1be841bbb84 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:53.775511 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ba6f7312-0f01-4122-9a1c-a1be841bbb84 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:53.783482 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ba6f7312-0f01-4122-9a1c-a1be841bbb84 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.154886 Aug 19 21:11:53.784073 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 194/358] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:53 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:11:54.032847 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-4acd7817-8c16-4618-b195-cb34b6b67000 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:54.033544 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-4acd7817-8c16-4618-b195-cb34b6b67000 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:54.041076 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4acd7817-8c16-4618-b195-cb34b6b67000 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:54.041561 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4acd7817-8c16-4618-b195-cb34b6b67000 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:54.042019 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4acd7817-8c16-4618-b195-cb34b6b67000 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:54.042713 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4acd7817-8c16-4618-b195-cb34b6b67000 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:54.043173 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4acd7817-8c16-4618-b195-cb34b6b67000 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:54.043586 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4acd7817-8c16-4618-b195-cb34b6b67000 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:54.278202 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-4acd7817-8c16-4618-b195-cb34b6b67000 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:54.293174 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-4acd7817-8c16-4618-b195-cb34b6b67000 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.264814 Aug 19 21:11:54.293894 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 165/359] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:54 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:54.806519 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-22119c5c-fa1c-4a7a-9972-21a265a0c723 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:54.807161 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-22119c5c-fa1c-4a7a-9972-21a265a0c723 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:54.813275 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-22119c5c-fa1c-4a7a-9972-21a265a0c723 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:54.813783 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-22119c5c-fa1c-4a7a-9972-21a265a0c723 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:54.814354 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-22119c5c-fa1c-4a7a-9972-21a265a0c723 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:54.815059 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-22119c5c-fa1c-4a7a-9972-21a265a0c723 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:54.815519 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-22119c5c-fa1c-4a7a-9972-21a265a0c723 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:54.815944 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-22119c5c-fa1c-4a7a-9972-21a265a0c723 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:54.967475 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-22119c5c-fa1c-4a7a-9972-21a265a0c723 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:54.976213 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-22119c5c-fa1c-4a7a-9972-21a265a0c723 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1312 microversion: 2.1 time: 0.174998 Aug 19 21:11:54.976791 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 195/360] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:54 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1312 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:55.316395 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-dde73af5-2c41-4984-ab19-527763a336da tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:55.317391 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-dde73af5-2c41-4984-ab19-527763a336da tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:55.323895 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dde73af5-2c41-4984-ab19-527763a336da tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:55.324410 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dde73af5-2c41-4984-ab19-527763a336da tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:55.324850 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dde73af5-2c41-4984-ab19-527763a336da tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:55.325554 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dde73af5-2c41-4984-ab19-527763a336da tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:55.326038 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dde73af5-2c41-4984-ab19-527763a336da tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:55.326463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dde73af5-2c41-4984-ab19-527763a336da tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:55.474688 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-dde73af5-2c41-4984-ab19-527763a336da tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:55.483329 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-dde73af5-2c41-4984-ab19-527763a336da tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.170695 Aug 19 21:11:55.483919 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 166/361] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:55 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:55.997894 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e42ec483-18b4-4172-a681-c03834fa202e tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:55.998563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-e42ec483-18b4-4172-a681-c03834fa202e tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:56.010094 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e42ec483-18b4-4172-a681-c03834fa202e tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:56.010605 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e42ec483-18b4-4172-a681-c03834fa202e tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:56.011037 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e42ec483-18b4-4172-a681-c03834fa202e tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:56.011737 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e42ec483-18b4-4172-a681-c03834fa202e tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:56.012187 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e42ec483-18b4-4172-a681-c03834fa202e tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:56.012607 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e42ec483-18b4-4172-a681-c03834fa202e tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:56.164781 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e42ec483-18b4-4172-a681-c03834fa202e tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:56.172956 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e42ec483-18b4-4172-a681-c03834fa202e tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1497 microversion: 2.1 time: 0.178957 Aug 19 21:11:56.173517 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 196/362] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:55 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:56.509523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-50e27d05-aff1-46ea-b979-f63793eb13d6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:56.510367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-50e27d05-aff1-46ea-b979-f63793eb13d6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:56.519201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-50e27d05-aff1-46ea-b979-f63793eb13d6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:56.519725 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-50e27d05-aff1-46ea-b979-f63793eb13d6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:56.520210 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-50e27d05-aff1-46ea-b979-f63793eb13d6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:56.521125 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-50e27d05-aff1-46ea-b979-f63793eb13d6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:56.521976 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-50e27d05-aff1-46ea-b979-f63793eb13d6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:56.522700 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-50e27d05-aff1-46ea-b979-f63793eb13d6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:56.542585 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=100 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:11:56.689260 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-50e27d05-aff1-46ea-b979-f63793eb13d6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:56.697680 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-50e27d05-aff1-46ea-b979-f63793eb13d6 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.194351 Aug 19 21:11:56.699152 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 167/363] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:56 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:56.772013 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-d1fe1c5f-c184-4917-9fc9-6c06728a9c79 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:56.772508 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-d1fe1c5f-c184-4917-9fc9-6c06728a9c79 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:56.779071 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d1fe1c5f-c184-4917-9fc9-6c06728a9c79 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:56.779560 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d1fe1c5f-c184-4917-9fc9-6c06728a9c79 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:56.779991 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d1fe1c5f-c184-4917-9fc9-6c06728a9c79 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:56.780722 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d1fe1c5f-c184-4917-9fc9-6c06728a9c79 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:56.781170 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d1fe1c5f-c184-4917-9fc9-6c06728a9c79 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:56.781590 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d1fe1c5f-c184-4917-9fc9-6c06728a9c79 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:56.810250 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-d1fe1c5f-c184-4917-9fc9-6c06728a9c79 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Going to try to terminate instance {{(pid=120877) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 21:11:56.925654 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-d1fe1c5f-c184-4917-9fc9-6c06728a9c79 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "DELETE /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 204 len: 0 microversion: 2.1 time: 0.157617 Aug 19 21:11:56.927283 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 197/364] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:11:56 2022] DELETE /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 21:11:56.936453 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-14c478d0-8907-48d3-a31d-1e4a402da861 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:56.937205 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-14c478d0-8907-48d3-a31d-1e4a402da861 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:56.944432 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-14c478d0-8907-48d3-a31d-1e4a402da861 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:56.945639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-14c478d0-8907-48d3-a31d-1e4a402da861 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:56.947763 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-14c478d0-8907-48d3-a31d-1e4a402da861 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:56.949057 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-14c478d0-8907-48d3-a31d-1e4a402da861 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:56.949927 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-14c478d0-8907-48d3-a31d-1e4a402da861 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:56.950726 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-14c478d0-8907-48d3-a31d-1e4a402da861 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:57.116207 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-14c478d0-8907-48d3-a31d-1e4a402da861 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:57.124218 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-14c478d0-8907-48d3-a31d-1e4a402da861 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1503 microversion: 2.1 time: 0.192305 Aug 19 21:11:57.124788 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 168/365] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:56 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1503 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:57.720282 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-82a9829b-437f-46ab-8900-cb5578c162d5 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:57.720878 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-82a9829b-437f-46ab-8900-cb5578c162d5 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:57.728975 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-82a9829b-437f-46ab-8900-cb5578c162d5 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:57.729463 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-82a9829b-437f-46ab-8900-cb5578c162d5 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:57.729946 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-82a9829b-437f-46ab-8900-cb5578c162d5 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:57.730642 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-82a9829b-437f-46ab-8900-cb5578c162d5 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:57.731088 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-82a9829b-437f-46ab-8900-cb5578c162d5 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:57.731513 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-82a9829b-437f-46ab-8900-cb5578c162d5 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:57.886205 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-82a9829b-437f-46ab-8900-cb5578c162d5 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:57.899665 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-82a9829b-437f-46ab-8900-cb5578c162d5 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.183598 Aug 19 21:11:57.900398 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 198/366] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:57 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:58.148810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-082521e2-237a-4863-9b13-ded51fe79b9d tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:58.149619 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-082521e2-237a-4863-9b13-ded51fe79b9d tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:58.156446 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-082521e2-237a-4863-9b13-ded51fe79b9d tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:58.156987 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-082521e2-237a-4863-9b13-ded51fe79b9d tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:58.157413 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-082521e2-237a-4863-9b13-ded51fe79b9d tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:58.158099 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-082521e2-237a-4863-9b13-ded51fe79b9d tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:58.158661 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-082521e2-237a-4863-9b13-ded51fe79b9d tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:58.159245 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-082521e2-237a-4863-9b13-ded51fe79b9d tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:58.329674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-082521e2-237a-4863-9b13-ded51fe79b9d tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:58.339751 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-082521e2-237a-4863-9b13-ded51fe79b9d tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1503 microversion: 2.1 time: 0.195999 Aug 19 21:11:58.340332 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 169/367] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:58 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1503 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:58.921103 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a7c99803-884c-48df-a47f-79765527b11b tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:58.921949 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-a7c99803-884c-48df-a47f-79765527b11b tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:58.929285 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a7c99803-884c-48df-a47f-79765527b11b tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:58.929802 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a7c99803-884c-48df-a47f-79765527b11b tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:58.930239 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a7c99803-884c-48df-a47f-79765527b11b tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:58.930953 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a7c99803-884c-48df-a47f-79765527b11b tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:58.931406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a7c99803-884c-48df-a47f-79765527b11b tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:58.931831 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a7c99803-884c-48df-a47f-79765527b11b tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:59.071802 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-a7c99803-884c-48df-a47f-79765527b11b tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:59.080179 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-a7c99803-884c-48df-a47f-79765527b11b tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.162868 Aug 19 21:11:59.080765 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 199/368] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:58 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:11:59.367135 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-c5f1b0f5-07d6-4a47-b06c-54581481f24f tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:11:59.368208 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-c5f1b0f5-07d6-4a47-b06c-54581481f24f tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:11:59.382666 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c5f1b0f5-07d6-4a47-b06c-54581481f24f tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:59.383609 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c5f1b0f5-07d6-4a47-b06c-54581481f24f tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:59.384424 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c5f1b0f5-07d6-4a47-b06c-54581481f24f tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:59.386172 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c5f1b0f5-07d6-4a47-b06c-54581481f24f tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:11:59.406636 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c5f1b0f5-07d6-4a47-b06c-54581481f24f tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:11:59.407351 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c5f1b0f5-07d6-4a47-b06c-54581481f24f tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:11:59.675817 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-c5f1b0f5-07d6-4a47-b06c-54581481f24f tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:11:59.685567 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-c5f1b0f5-07d6-4a47-b06c-54581481f24f tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1503 microversion: 2.1 time: 0.327746 Aug 19 21:11:59.686197 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 170/369] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:11:59 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1503 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:00.102278 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-39f9246a-c8d1-44fa-b077-ff242b71d41f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:00.103623 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-39f9246a-c8d1-44fa-b077-ff242b71d41f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:00.111152 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-39f9246a-c8d1-44fa-b077-ff242b71d41f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:00.112032 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-39f9246a-c8d1-44fa-b077-ff242b71d41f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:00.112527 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-39f9246a-c8d1-44fa-b077-ff242b71d41f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:00.113466 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-39f9246a-c8d1-44fa-b077-ff242b71d41f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:00.114739 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-39f9246a-c8d1-44fa-b077-ff242b71d41f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:00.115253 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-39f9246a-c8d1-44fa-b077-ff242b71d41f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:00.367639 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-39f9246a-c8d1-44fa-b077-ff242b71d41f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:00.388111 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-39f9246a-c8d1-44fa-b077-ff242b71d41f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.279465 Aug 19 21:12:00.388111 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 200/370] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:00 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:00.646649 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-9c77f675-99ef-4013-b84a-efa332d34060 req-7377aff5-1511-4c0f-8828-0e3f8e179411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345e628f-70ab-410e-8b94-06ca1343492e", "name": "network-vif-deleted", "tag": "d27c6406-4abb-4095-ad1e-f0db5b6e3763"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:12:00.671552 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-9c77f675-99ef-4013-b84a-efa332d34060 req-7377aff5-1511-4c0f-8828-0e3f8e179411 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:00.671552 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-9c77f675-99ef-4013-b84a-efa332d34060 req-7377aff5-1511-4c0f-8828-0e3f8e179411 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:00.671552 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-9c77f675-99ef-4013-b84a-efa332d34060 req-7377aff5-1511-4c0f-8828-0e3f8e179411 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:00.685280 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-9c77f675-99ef-4013-b84a-efa332d34060 req-7377aff5-1511-4c0f-8828-0e3f8e179411 service nova] Creating event network-vif-deleted:d27c6406-4abb-4095-ad1e-f0db5b6e3763 for instance 345e628f-70ab-410e-8b94-06ca1343492e on hv-cinder-85220 Aug 19 21:12:00.691007 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-9c77f675-99ef-4013-b84a-efa332d34060 req-7377aff5-1511-4c0f-8828-0e3f8e179411 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051612 Aug 19 21:12:00.691616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 171/371] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:12:00.714698 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c3466015-5fcf-48ee-9e8b-067afe4b1684 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:00.715772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-c3466015-5fcf-48ee-9e8b-067afe4b1684 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:00.728192 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c3466015-5fcf-48ee-9e8b-067afe4b1684 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:00.729162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c3466015-5fcf-48ee-9e8b-067afe4b1684 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:00.729970 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c3466015-5fcf-48ee-9e8b-067afe4b1684 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:00.731479 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c3466015-5fcf-48ee-9e8b-067afe4b1684 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:00.732344 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c3466015-5fcf-48ee-9e8b-067afe4b1684 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:00.733079 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c3466015-5fcf-48ee-9e8b-067afe4b1684 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:00.841756 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c3466015-5fcf-48ee-9e8b-067afe4b1684 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:00.857247 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-c3466015-5fcf-48ee-9e8b-067afe4b1684 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 200 len: 1297 microversion: 2.1 time: 0.151345 Aug 19 21:12:00.858373 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 201/372] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:00 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 1297 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:01.408603 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-7456f640-dea6-47a8-a3cd-733cc9ba2235 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:01.409100 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-7456f640-dea6-47a8-a3cd-733cc9ba2235 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:01.419610 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7456f640-dea6-47a8-a3cd-733cc9ba2235 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:01.419998 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7456f640-dea6-47a8-a3cd-733cc9ba2235 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:01.420487 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7456f640-dea6-47a8-a3cd-733cc9ba2235 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:01.421162 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7456f640-dea6-47a8-a3cd-733cc9ba2235 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:01.421625 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7456f640-dea6-47a8-a3cd-733cc9ba2235 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:01.422092 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7456f640-dea6-47a8-a3cd-733cc9ba2235 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:01.598914 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-7456f640-dea6-47a8-a3cd-733cc9ba2235 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:01.610139 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-7456f640-dea6-47a8-a3cd-733cc9ba2235 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.206424 Aug 19 21:12:01.611200 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 172/373] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:01 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:01.794729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-6e766176-8043-4357-8390-c26a462dde8c req-8def2d6b-d303-49ba-bd6e-4b563863abf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea09e576-f3ee-4b10-813f-23574635c10c", "name": "network-vif-plugged", "status": "completed", "tag": "dc06a7d7-d9fe-4dd6-8dab-d1c3f12f11f3"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:12:01.811980 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-6e766176-8043-4357-8390-c26a462dde8c req-8def2d6b-d303-49ba-bd6e-4b563863abf7 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:01.812974 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-6e766176-8043-4357-8390-c26a462dde8c req-8def2d6b-d303-49ba-bd6e-4b563863abf7 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:01.818365 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-6e766176-8043-4357-8390-c26a462dde8c req-8def2d6b-d303-49ba-bd6e-4b563863abf7 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:01.843782 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-6e766176-8043-4357-8390-c26a462dde8c req-8def2d6b-d303-49ba-bd6e-4b563863abf7 service nova] Creating event network-vif-plugged:dc06a7d7-d9fe-4dd6-8dab-d1c3f12f11f3 for instance ea09e576-f3ee-4b10-813f-23574635c10c on hv-cinder-85220 Aug 19 21:12:01.852247 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-6e766176-8043-4357-8390-c26a462dde8c req-8def2d6b-d303-49ba-bd6e-4b563863abf7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067145 Aug 19 21:12:01.852926 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 202/374] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:12:01.884224 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-42e31f4e-998f-4a4f-868a-71451f2a4fac tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:01.885392 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-42e31f4e-998f-4a4f-868a-71451f2a4fac tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: 345e628f-70ab-410e-8b94-06ca1343492e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:01.899592 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-42e31f4e-998f-4a4f-868a-71451f2a4fac tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:01.900389 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-42e31f4e-998f-4a4f-868a-71451f2a4fac tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:01.901232 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-42e31f4e-998f-4a4f-868a-71451f2a4fac tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:01.902659 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-42e31f4e-998f-4a4f-868a-71451f2a4fac tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:01.903958 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-42e31f4e-998f-4a4f-868a-71451f2a4fac tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:01.904666 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-42e31f4e-998f-4a4f-868a-71451f2a4fac tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:01.921343 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-42e31f4e-998f-4a4f-868a-71451f2a4fac tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] HTTP exception thrown: Instance 345e628f-70ab-410e-8b94-06ca1343492e could not be found. Aug 19 21:12:01.923695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-42e31f4e-998f-4a4f-868a-71451f2a4fac tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Request method failure captured: Aug 19 21:12:01.923695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e HTTP/1.1 Aug 19 21:12:01.923695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:12:01.923695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:12:01.923695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:12:01.923695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:12:01.923695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:12:01.923695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:12:01.923695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:12:01.923695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:12:01.923695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__xw3LimdGnnyTz-Y4fTVtqyDXJejGeZlQoDPhn3Cny6RtoKB1SGmJqpDkFVQGoFmra-7wYRtJWHgf8yKh2tSgk-8RjPy3lr8dpKmyuPIt4OVE6T7zj6Zl5zRqrx8g3F7DbrVa7yAuf7CqbMjnbiwvznzaF2wbeo8VgNckDy0OM-ksQ Aug 19 21:12:01.923695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:12:01.923695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:12:01.923695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:12:01.923695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:12:01.923695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:12:01.923695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:12:01.923695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: c600e063ecf4490087703e6f9c87cefb Aug 19 21:12:01.923695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-VolumesActionsTest-894176538 Aug 19 21:12:01.923695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:12:01.923695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:12:01.926714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c600e063ecf4490087703e6f9c87cefb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c600e063ecf4490087703e6f9c87cefb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c600e063ecf4490087703e6f9c87cefb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c600e063ecf4490087703e6f9c87cefb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:12:01.926714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-VolumesActionsTest-894176538 Aug 19 21:12:01.926714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: c600e063ecf4490087703e6f9c87cefb Aug 19 21:12:01.926714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-VolumesActionsTest-894176538 Aug 19 21:12:01.926714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-VolumesActionsTest-894176538-project Aug 19 21:12:01.926714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:12:01.926714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:12:01.926714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: d0576905fd534e1ead96f5da9a817bb7 Aug 19 21:12:01.926714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-VolumesActionsTest-894176538-project Aug 19 21:12:01.926714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: > Aug 19 21:12:01.926714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Instance 345e628f-70ab-410e-8b94-06ca1343492e could not be found. Aug 19 21:12:01.926714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': '345e628f-70ab-410e-8b94-06ca1343492e'} Aug 19 21:12:01.928538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:12:01.928538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:12:01.928538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:12:01.928538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:12:01.928538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:12:01.928538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:12:01.928538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:12:01.928538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:12:01.928538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:12:01.928538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:12:01.928538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 345e628f-70ab-410e-8b94-06ca1343492e could not be found. Aug 19 21:12:01.928538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:12:01.928538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:12:01.928538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:12:01.928538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:12:01.928538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:12:01.928538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:12:01.928538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:12:01.928538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:12:01.928538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:12:01.931697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:12:01.931697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:12:01.931697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:12:01.931697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:12:01.931697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:12:01.931697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:12:01.931697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:12:01.931697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 345e628f-70ab-410e-8b94-06ca1343492e could not be found. Aug 19 21:12:01.931697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:12:01.931697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:12:01.931697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:12:01.931697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:12:01.931697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:12:01.931697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:12:01.931697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:12:01.931697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:12:01.931697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 345e628f-70ab-410e-8b94-06ca1343492e could not be found. Aug 19 21:12:01.931697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:12:01.935902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-42e31f4e-998f-4a4f-868a-71451f2a4fac tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Returning 404 to user: Instance 345e628f-70ab-410e-8b94-06ca1343492e could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:12:01.935902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-42e31f4e-998f-4a4f-868a-71451f2a4fac tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e" status: 404 len: 111 microversion: 2.1 time: 0.048126 Aug 19 21:12:01.935902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 173/375] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:01 2022] GET /compute/v2.1/servers/345e628f-70ab-410e-8b94-06ca1343492e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:12:02.083299 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-1716b957-2b36-4513-8ed4-be3edca8025b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-724284992", "imageRef": "d1f034cf-f103-477b-bbb5-3298c678db05", "flavorRef": "452", "networks": [{"uuid": "4b7390f6-ea1a-4766-a73e-9b7628c2625b"}]}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:12:02.162674 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.network.neutron [None req-1716b957-2b36-4513-8ed4-be3edca8025b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] validate_networks() for [('4b7390f6-ea1a-4766-a73e-9b7628c2625b', None, None, None, None, None)] {{(pid=120877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 21:12:02.636413 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-e71ed38e-a595-4356-a6f5-e52e4dbbf1bf tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:02.639106 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-e71ed38e-a595-4356-a6f5-e52e4dbbf1bf tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:02.664460 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e71ed38e-a595-4356-a6f5-e52e4dbbf1bf tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:02.667640 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e71ed38e-a595-4356-a6f5-e52e4dbbf1bf tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:02.673636 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e71ed38e-a595-4356-a6f5-e52e4dbbf1bf tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:02.675128 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e71ed38e-a595-4356-a6f5-e52e4dbbf1bf tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:02.677896 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e71ed38e-a595-4356-a6f5-e52e4dbbf1bf tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:02.678929 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e71ed38e-a595-4356-a6f5-e52e4dbbf1bf tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:02.685198 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-1716b957-2b36-4513-8ed4-be3edca8025b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Flavor limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 21:12:02.686124 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-1716b957-2b36-4513-8ed4-be3edca8025b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Image limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 21:12:02.687077 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-1716b957-2b36-4513-8ed4-be3edca8025b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Flavor pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 21:12:02.687881 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-1716b957-2b36-4513-8ed4-be3edca8025b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Image pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 21:12:02.688478 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-1716b957-2b36-4513-8ed4-be3edca8025b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 21:12:02.706433 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1716b957-2b36-4513-8ed4-be3edca8025b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:02.707571 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1716b957-2b36-4513-8ed4-be3edca8025b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:02.708346 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1716b957-2b36-4513-8ed4-be3edca8025b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:02.710595 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1716b957-2b36-4513-8ed4-be3edca8025b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:02.711313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1716b957-2b36-4513-8ed4-be3edca8025b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:02.711926 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1716b957-2b36-4513-8ed4-be3edca8025b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:02.743040 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-1716b957-2b36-4513-8ed4-be3edca8025b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Getting quotas for project c600e063ecf4490087703e6f9c87cefb. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:12:02.751557 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-1716b957-2b36-4513-8ed4-be3edca8025b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Getting quotas for user d0576905fd534e1ead96f5da9a817bb7 and project c600e063ecf4490087703e6f9c87cefb. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:12:02.792385 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-1716b957-2b36-4513-8ed4-be3edca8025b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Going to run 1 instances... {{(pid=120877) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 21:12:02.800331 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-1716b957-2b36-4513-8ed4-be3edca8025b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: df7f52d4-35a4-4f3f-8740-ed6002a4e62f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f034cf-f103-477b-bbb5-3298c678db05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 21:12:02.888480 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-1716b957-2b36-4513-8ed4-be3edca8025b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.809532 Aug 19 21:12:02.889501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 203/376] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Aug 19 21:12:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 21:12:02.912073 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-771c37ac-5b3e-4041-8280-505aacb40de0 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:02.914066 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-771c37ac-5b3e-4041-8280-505aacb40de0 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: df7f52d4-35a4-4f3f-8740-ed6002a4e62f] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:02.918788 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-e71ed38e-a595-4356-a6f5-e52e4dbbf1bf tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:02.942806 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-e71ed38e-a595-4356-a6f5-e52e4dbbf1bf tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.313129 Aug 19 21:12:02.944603 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 174/377] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:02 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:12:03.018554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-771c37ac-5b3e-4041-8280-505aacb40de0 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:03.027292 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-771c37ac-5b3e-4041-8280-505aacb40de0 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f" status: 200 len: 1213 microversion: 2.1 time: 0.126150 Aug 19 21:12:03.028452 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 204/378] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:02 2022] GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f => generated 1213 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:12:03.853261 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-f3a70ebd-a4ed-4441-b5d8-2382c695d802 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:03.853787 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-f3a70ebd-a4ed-4441-b5d8-2382c695d802 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:03.861012 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f3a70ebd-a4ed-4441-b5d8-2382c695d802 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:03.861511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f3a70ebd-a4ed-4441-b5d8-2382c695d802 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:03.862011 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f3a70ebd-a4ed-4441-b5d8-2382c695d802 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:03.862739 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f3a70ebd-a4ed-4441-b5d8-2382c695d802 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:03.863243 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f3a70ebd-a4ed-4441-b5d8-2382c695d802 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:03.863616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f3a70ebd-a4ed-4441-b5d8-2382c695d802 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:03.899738 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-f3a70ebd-a4ed-4441-b5d8-2382c695d802 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae/ips" status: 200 len: 148 microversion: 2.1 time: 0.050283 Aug 19 21:12:03.900657 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 175/379] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Aug 19 21:12:03 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae/ips => generated 148 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:12:03.983388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-00722397-76cc-412c-9d20-95e40a317a76 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:03.985405 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-00722397-76cc-412c-9d20-95e40a317a76 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:04.069427 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-8407284a-8799-434d-a7f8-5d7229511cb9 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:04.071667 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-8407284a-8799-434d-a7f8-5d7229511cb9 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: df7f52d4-35a4-4f3f-8740-ed6002a4e62f] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:04.097581 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8407284a-8799-434d-a7f8-5d7229511cb9 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:04.099047 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8407284a-8799-434d-a7f8-5d7229511cb9 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:04.099775 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8407284a-8799-434d-a7f8-5d7229511cb9 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:04.101105 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8407284a-8799-434d-a7f8-5d7229511cb9 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:04.101812 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8407284a-8799-434d-a7f8-5d7229511cb9 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:04.102535 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8407284a-8799-434d-a7f8-5d7229511cb9 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:04.219181 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-00722397-76cc-412c-9d20-95e40a317a76 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:04.220503 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-00722397-76cc-412c-9d20-95e40a317a76 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:04.221876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-00722397-76cc-412c-9d20-95e40a317a76 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:04.224199 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-00722397-76cc-412c-9d20-95e40a317a76 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:04.225375 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-00722397-76cc-412c-9d20-95e40a317a76 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:04.227585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-00722397-76cc-412c-9d20-95e40a317a76 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:04.336874 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-8407284a-8799-434d-a7f8-5d7229511cb9 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:04.354896 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-8407284a-8799-434d-a7f8-5d7229511cb9 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f" status: 200 len: 1265 microversion: 2.1 time: 0.292923 Aug 19 21:12:04.361928 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 176/380] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:04 2022] GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f => generated 1265 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:12:04.528081 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-00722397-76cc-412c-9d20-95e40a317a76 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:04.543654 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-00722397-76cc-412c-9d20-95e40a317a76 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1359 microversion: 2.1 time: 0.566605 Aug 19 21:12:04.544930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 205/381] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:03 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1359 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:05.380225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d80e1bcc-b704-4f53-aff0-10ebe006fdbe tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:05.381793 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-d80e1bcc-b704-4f53-aff0-10ebe006fdbe tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: df7f52d4-35a4-4f3f-8740-ed6002a4e62f] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:05.388689 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d80e1bcc-b704-4f53-aff0-10ebe006fdbe tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:05.389167 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d80e1bcc-b704-4f53-aff0-10ebe006fdbe tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:05.389597 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d80e1bcc-b704-4f53-aff0-10ebe006fdbe tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:05.390344 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d80e1bcc-b704-4f53-aff0-10ebe006fdbe tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:05.390800 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d80e1bcc-b704-4f53-aff0-10ebe006fdbe tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:05.391244 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d80e1bcc-b704-4f53-aff0-10ebe006fdbe tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:05.463065 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-d80e1bcc-b704-4f53-aff0-10ebe006fdbe tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:05.471346 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-d80e1bcc-b704-4f53-aff0-10ebe006fdbe tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f" status: 200 len: 1271 microversion: 2.1 time: 0.096252 Aug 19 21:12:05.471924 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 177/382] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:05 2022] GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:05.573207 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-76b1b577-b322-4060-966b-db9de1590416 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:05.574063 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-76b1b577-b322-4060-966b-db9de1590416 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:05.580922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-76b1b577-b322-4060-966b-db9de1590416 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:05.581420 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-76b1b577-b322-4060-966b-db9de1590416 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:05.581886 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-76b1b577-b322-4060-966b-db9de1590416 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:05.582696 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-76b1b577-b322-4060-966b-db9de1590416 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:05.583150 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-76b1b577-b322-4060-966b-db9de1590416 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:05.583567 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-76b1b577-b322-4060-966b-db9de1590416 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:05.706234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-625d8790-2d97-4142-8bfc-6ca12903c13f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:05.706866 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-625d8790-2d97-4142-8bfc-6ca12903c13f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:05.714508 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-625d8790-2d97-4142-8bfc-6ca12903c13f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:05.715002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-625d8790-2d97-4142-8bfc-6ca12903c13f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:05.715436 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-625d8790-2d97-4142-8bfc-6ca12903c13f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:05.716155 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-625d8790-2d97-4142-8bfc-6ca12903c13f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:05.716612 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-625d8790-2d97-4142-8bfc-6ca12903c13f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:05.717036 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-625d8790-2d97-4142-8bfc-6ca12903c13f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:05.746372 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-625d8790-2d97-4142-8bfc-6ca12903c13f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2/ips" status: 200 len: 151 microversion: 2.20 time: 0.044167 Aug 19 21:12:05.747083 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 178/383] 10.222.0.16 () {60 vars in 1289 bytes} [Fri Aug 19 21:12:05 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 21:12:05.755852 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-76b1b577-b322-4060-966b-db9de1590416 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:05.769241 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-76b1b577-b322-4060-966b-db9de1590416 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1549 microversion: 2.1 time: 0.206423 Aug 19 21:12:05.771954 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 206/384] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:05 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1549 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:05.803672 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-53de4027-31a9-470a-b874-a47f3d440b1d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:05.804377 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-53de4027-31a9-470a-b874-a47f3d440b1d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:05.810950 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-53de4027-31a9-470a-b874-a47f3d440b1d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:05.811534 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-53de4027-31a9-470a-b874-a47f3d440b1d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:05.812035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-53de4027-31a9-470a-b874-a47f3d440b1d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:05.812755 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-53de4027-31a9-470a-b874-a47f3d440b1d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:05.813211 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-53de4027-31a9-470a-b874-a47f3d440b1d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:05.813736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-53de4027-31a9-470a-b874-a47f3d440b1d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:05.986649 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-53de4027-31a9-470a-b874-a47f3d440b1d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:05.999888 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-53de4027-31a9-470a-b874-a47f3d440b1d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1549 microversion: 2.1 time: 0.199906 Aug 19 21:12:06.000973 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 179/385] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:05 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1549 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:12:06.030532 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-08a79c38-27b3-499c-8cbf-11979d635cf1 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:06.038685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-08a79c38-27b3-499c-8cbf-11979d635cf1 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:06.040447 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-08a79c38-27b3-499c-8cbf-11979d635cf1 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Searching by: {'deleted': False, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a'} {{(pid=120877) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 19 21:12:06.050319 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-08a79c38-27b3-499c-8cbf-11979d635cf1 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:06.050978 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-08a79c38-27b3-499c-8cbf-11979d635cf1 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:06.052228 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-08a79c38-27b3-499c-8cbf-11979d635cf1 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:06.053199 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-08a79c38-27b3-499c-8cbf-11979d635cf1 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:06.053873 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-08a79c38-27b3-499c-8cbf-11979d635cf1 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:06.054556 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-08a79c38-27b3-499c-8cbf-11979d635cf1 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:06.244489 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.multi_cell_list [None req-08a79c38-27b3-499c-8cbf-11979d635cf1 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120877) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 19 21:12:06.307318 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:06.353401 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-08a79c38-27b3-499c-8cbf-11979d635cf1 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.329273 Aug 19 21:12:06.354027 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 207/386] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Aug 19 21:12:06 2022] GET /compute/v2.1/servers => generated 343 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:12:06.366573 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-e2c0f4c6-3c7d-43f9-865e-9cedb91575eb tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:06.367321 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-e2c0f4c6-3c7d-43f9-865e-9cedb91575eb tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:06.374264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e2c0f4c6-3c7d-43f9-865e-9cedb91575eb tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:06.374756 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e2c0f4c6-3c7d-43f9-865e-9cedb91575eb tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:06.375186 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e2c0f4c6-3c7d-43f9-865e-9cedb91575eb tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:06.375902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e2c0f4c6-3c7d-43f9-865e-9cedb91575eb tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:06.376350 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e2c0f4c6-3c7d-43f9-865e-9cedb91575eb tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:06.376801 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e2c0f4c6-3c7d-43f9-865e-9cedb91575eb tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:06.494602 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ce550173-c0f8-44bb-831a-e39cd85962c7 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:06.495528 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ce550173-c0f8-44bb-831a-e39cd85962c7 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: df7f52d4-35a4-4f3f-8740-ed6002a4e62f] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:06.506544 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce550173-c0f8-44bb-831a-e39cd85962c7 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:06.507243 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce550173-c0f8-44bb-831a-e39cd85962c7 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:06.507819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce550173-c0f8-44bb-831a-e39cd85962c7 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:06.508687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce550173-c0f8-44bb-831a-e39cd85962c7 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:06.509270 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce550173-c0f8-44bb-831a-e39cd85962c7 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:06.509997 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce550173-c0f8-44bb-831a-e39cd85962c7 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:06.546446 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-e2c0f4c6-3c7d-43f9-865e-9cedb91575eb tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:06.555505 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-e2c0f4c6-3c7d-43f9-865e-9cedb91575eb tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1549 microversion: 2.1 time: 0.193384 Aug 19 21:12:06.556129 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 180/387] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:06 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1549 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:12:06.598900 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ce550173-c0f8-44bb-831a-e39cd85962c7 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:06.609137 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ce550173-c0f8-44bb-831a-e39cd85962c7 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f" status: 200 len: 1271 microversion: 2.1 time: 0.119623 Aug 19 21:12:06.610385 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 208/388] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:06 2022] GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f => generated 1271 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:12:07.652121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-80d14305-5ae7-49c8-9c07-26937515afbb tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:07.653303 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-80d14305-5ae7-49c8-9c07-26937515afbb tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: df7f52d4-35a4-4f3f-8740-ed6002a4e62f] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:07.665834 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-80d14305-5ae7-49c8-9c07-26937515afbb tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:07.666551 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-80d14305-5ae7-49c8-9c07-26937515afbb tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:07.667340 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-80d14305-5ae7-49c8-9c07-26937515afbb tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:07.668623 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-80d14305-5ae7-49c8-9c07-26937515afbb tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:07.669414 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-80d14305-5ae7-49c8-9c07-26937515afbb tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:07.670224 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-80d14305-5ae7-49c8-9c07-26937515afbb tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:07.800360 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-80d14305-5ae7-49c8-9c07-26937515afbb tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:07.813863 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-80d14305-5ae7-49c8-9c07-26937515afbb tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f" status: 200 len: 1271 microversion: 2.1 time: 0.169716 Aug 19 21:12:07.814787 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 181/389] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:07 2022] GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f => generated 1271 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:08.841277 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-07eaf928-e460-4c47-80d3-0341de5f8aee tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:08.842196 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-07eaf928-e460-4c47-80d3-0341de5f8aee tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: df7f52d4-35a4-4f3f-8740-ed6002a4e62f] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:08.844224 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:08.852442 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-07eaf928-e460-4c47-80d3-0341de5f8aee tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:08.853292 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-07eaf928-e460-4c47-80d3-0341de5f8aee tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:08.853933 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-07eaf928-e460-4c47-80d3-0341de5f8aee tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:08.854804 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-07eaf928-e460-4c47-80d3-0341de5f8aee tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:08.855476 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-07eaf928-e460-4c47-80d3-0341de5f8aee tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:08.856033 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-07eaf928-e460-4c47-80d3-0341de5f8aee tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:09.048105 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-07eaf928-e460-4c47-80d3-0341de5f8aee tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:09.059851 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-07eaf928-e460-4c47-80d3-0341de5f8aee tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f" status: 200 len: 1313 microversion: 2.1 time: 0.224532 Aug 19 21:12:09.060786 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 209/390] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:08 2022] GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:09.640301 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-d69d8fd3-1671-4514-a851-160897240fa6 req-0c7a9add-6d86-427c-b1f9-d550ed4083d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df7f52d4-35a4-4f3f-8740-ed6002a4e62f", "tag": "808ad7a8-7f08-47ac-ad42-742a0b87689e"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:12:09.655919 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-d69d8fd3-1671-4514-a851-160897240fa6 req-0c7a9add-6d86-427c-b1f9-d550ed4083d0 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:09.656398 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-d69d8fd3-1671-4514-a851-160897240fa6 req-0c7a9add-6d86-427c-b1f9-d550ed4083d0 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:09.656829 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-d69d8fd3-1671-4514-a851-160897240fa6 req-0c7a9add-6d86-427c-b1f9-d550ed4083d0 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:09.670342 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-d69d8fd3-1671-4514-a851-160897240fa6 req-0c7a9add-6d86-427c-b1f9-d550ed4083d0 service nova] Creating event network-changed:808ad7a8-7f08-47ac-ad42-742a0b87689e for instance df7f52d4-35a4-4f3f-8740-ed6002a4e62f on hv-cinder-85220 Aug 19 21:12:09.680185 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-d69d8fd3-1671-4514-a851-160897240fa6 req-0c7a9add-6d86-427c-b1f9-d550ed4083d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043502 Aug 19 21:12:09.681372 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 182/391] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:12:10.080623 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-9d2592b0-0883-41d5-a140-202c778c3481 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:10.081262 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-9d2592b0-0883-41d5-a140-202c778c3481 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: df7f52d4-35a4-4f3f-8740-ed6002a4e62f] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:10.088499 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9d2592b0-0883-41d5-a140-202c778c3481 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:10.088987 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9d2592b0-0883-41d5-a140-202c778c3481 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:10.089898 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9d2592b0-0883-41d5-a140-202c778c3481 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:10.090137 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9d2592b0-0883-41d5-a140-202c778c3481 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:10.090584 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9d2592b0-0883-41d5-a140-202c778c3481 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:10.091360 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9d2592b0-0883-41d5-a140-202c778c3481 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:10.531156 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-9d2592b0-0883-41d5-a140-202c778c3481 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:10.540146 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-9d2592b0-0883-41d5-a140-202c778c3481 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f" status: 200 len: 1313 microversion: 2.1 time: 0.463454 Aug 19 21:12:10.540745 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 210/392] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:10 2022] GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f => generated 1313 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:10.981686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-fe8ba0c6-e434-4ec4-850f-47cb62d33202 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ff37e1e-37bb-480c-a9e3-cac7418d7084"}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:12:10.984464 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-fe8ba0c6-e434-4ec4-850f-47cb62d33202 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:10.992169 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fe8ba0c6-e434-4ec4-850f-47cb62d33202 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:10.992690 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fe8ba0c6-e434-4ec4-850f-47cb62d33202 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:10.993196 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fe8ba0c6-e434-4ec4-850f-47cb62d33202 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:10.993965 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fe8ba0c6-e434-4ec4-850f-47cb62d33202 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:10.994452 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fe8ba0c6-e434-4ec4-850f-47cb62d33202 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:10.994884 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fe8ba0c6-e434-4ec4-850f-47cb62d33202 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:11.564197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-77ade62e-9208-43fd-be3e-b241888a9115 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:11.564917 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-77ade62e-9208-43fd-be3e-b241888a9115 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: df7f52d4-35a4-4f3f-8740-ed6002a4e62f] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:11.572731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-77ade62e-9208-43fd-be3e-b241888a9115 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:11.573218 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-77ade62e-9208-43fd-be3e-b241888a9115 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:11.573652 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-77ade62e-9208-43fd-be3e-b241888a9115 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:11.574378 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-77ade62e-9208-43fd-be3e-b241888a9115 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:11.574829 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-77ade62e-9208-43fd-be3e-b241888a9115 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:11.575243 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-77ade62e-9208-43fd-be3e-b241888a9115 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:11.751507 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-77ade62e-9208-43fd-be3e-b241888a9115 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:11.769934 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-77ade62e-9208-43fd-be3e-b241888a9115 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f" status: 200 len: 1313 microversion: 2.1 time: 0.211234 Aug 19 21:12:11.772582 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 211/393] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:11 2022] GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:12.033674 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-cb006826-42fb-434e-aa50-7bd83f905fdf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:12:12.034280 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-cb006826-42fb-434e-aa50-7bd83f905fdf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:12.041135 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cb006826-42fb-434e-aa50-7bd83f905fdf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:12.041628 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cb006826-42fb-434e-aa50-7bd83f905fdf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:12.042093 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cb006826-42fb-434e-aa50-7bd83f905fdf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:12.042809 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cb006826-42fb-434e-aa50-7bd83f905fdf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:12.043267 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cb006826-42fb-434e-aa50-7bd83f905fdf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:12.043687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cb006826-42fb-434e-aa50-7bd83f905fdf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:12.072242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.objects.instance [None req-cb006826-42fb-434e-aa50-7bd83f905fdf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lazy-loading 'flavor' on Instance uuid f95c060a-e4cc-436c-a185-9345fd2c44f2 {{(pid=120877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:12:12.408799 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-cb006826-42fb-434e-aa50-7bd83f905fdf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "POST /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2/action" status: 202 len: 0 microversion: 2.20 time: 0.379228 Aug 19 21:12:12.409938 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 212/394] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Aug 19 21:12:12 2022] POST /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 19 21:12:12.423065 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-1e4bcb40-7f1a-4da1-bf0b-26f24892eeb3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:12.423785 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-1e4bcb40-7f1a-4da1-bf0b-26f24892eeb3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:12.431587 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1e4bcb40-7f1a-4da1-bf0b-26f24892eeb3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:12.432100 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1e4bcb40-7f1a-4da1-bf0b-26f24892eeb3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:12.432537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1e4bcb40-7f1a-4da1-bf0b-26f24892eeb3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:12.433239 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1e4bcb40-7f1a-4da1-bf0b-26f24892eeb3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:12.433697 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1e4bcb40-7f1a-4da1-bf0b-26f24892eeb3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:12.434146 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1e4bcb40-7f1a-4da1-bf0b-26f24892eeb3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:12.595465 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-1e4bcb40-7f1a-4da1-bf0b-26f24892eeb3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:12.606589 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-1e4bcb40-7f1a-4da1-bf0b-26f24892eeb3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:12.608329 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-1e4bcb40-7f1a-4da1-bf0b-26f24892eeb3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:12.609738 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-1e4bcb40-7f1a-4da1-bf0b-26f24892eeb3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1722 microversion: 2.20 time: 0.192976 Aug 19 21:12:12.610559 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 213/395] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:12 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:12:12.742527 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8d00d667-0398-4a18-a1a9-b01947407263 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff854d78-15a0-44a4-a01f-3568c8d7f76f"}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:12:12.746746 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8d00d667-0398-4a18-a1a9-b01947407263 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:12.757255 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8d00d667-0398-4a18-a1a9-b01947407263 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:12.758152 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8d00d667-0398-4a18-a1a9-b01947407263 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:12.758829 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8d00d667-0398-4a18-a1a9-b01947407263 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:12.760094 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8d00d667-0398-4a18-a1a9-b01947407263 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:12.760659 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8d00d667-0398-4a18-a1a9-b01947407263 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:12.761238 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8d00d667-0398-4a18-a1a9-b01947407263 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:13.024538 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=8 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:14.081387 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8d00d667-0398-4a18-a1a9-b01947407263 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "POST /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.346000 Aug 19 21:12:14.082817 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 214/396] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Aug 19 21:12:12 2022] POST /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c/os-volume_attachments => generated 194 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:12:14.089415 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-b51f0fd9-20ca-49b8-9995-abe925d3f162 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:14.090516 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-b51f0fd9-20ca-49b8-9995-abe925d3f162 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: df7f52d4-35a4-4f3f-8740-ed6002a4e62f] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:14.120366 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b51f0fd9-20ca-49b8-9995-abe925d3f162 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:14.122308 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b51f0fd9-20ca-49b8-9995-abe925d3f162 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:14.123587 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b51f0fd9-20ca-49b8-9995-abe925d3f162 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:14.127969 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b51f0fd9-20ca-49b8-9995-abe925d3f162 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:14.130648 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b51f0fd9-20ca-49b8-9995-abe925d3f162 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:14.131983 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b51f0fd9-20ca-49b8-9995-abe925d3f162 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:14.251370 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-fe8ba0c6-e434-4ec4-850f-47cb62d33202 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "POST /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.274363 Aug 19 21:12:14.252254 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 183/397] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Aug 19 21:12:10 2022] POST /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae/os-volume_attachments => generated 194 bytes in 3276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:12:14.264671 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-831c3062-7bf0-4390-b790-6cef2e1b5f5e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:14.269287 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-831c3062-7bf0-4390-b790-6cef2e1b5f5e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:14.279811 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-831c3062-7bf0-4390-b790-6cef2e1b5f5e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:14.281084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-831c3062-7bf0-4390-b790-6cef2e1b5f5e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:14.281692 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-831c3062-7bf0-4390-b790-6cef2e1b5f5e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:14.282858 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-831c3062-7bf0-4390-b790-6cef2e1b5f5e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:14.283580 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-831c3062-7bf0-4390-b790-6cef2e1b5f5e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:14.289666 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-831c3062-7bf0-4390-b790-6cef2e1b5f5e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:14.687531 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-b51f0fd9-20ca-49b8-9995-abe925d3f162 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:14.697982 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-b51f0fd9-20ca-49b8-9995-abe925d3f162 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f" status: 200 len: 1313 microversion: 2.1 time: 0.613646 Aug 19 21:12:14.698880 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 215/398] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:14 2022] GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f => generated 1313 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:14.726710 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-831c3062-7bf0-4390-b790-6cef2e1b5f5e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:14.749704 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-831c3062-7bf0-4390-b790-6cef2e1b5f5e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:14.751651 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-831c3062-7bf0-4390-b790-6cef2e1b5f5e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:14.753062 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-831c3062-7bf0-4390-b790-6cef2e1b5f5e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1722 microversion: 2.20 time: 0.499966 Aug 19 21:12:14.753830 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 184/399] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:14 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1722 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:15.720754 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-32ad09ed-b21e-4d96-8a3e-c36f05a4e45a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:15.721692 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-32ad09ed-b21e-4d96-8a3e-c36f05a4e45a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: df7f52d4-35a4-4f3f-8740-ed6002a4e62f] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:15.731168 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-32ad09ed-b21e-4d96-8a3e-c36f05a4e45a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:15.731703 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-32ad09ed-b21e-4d96-8a3e-c36f05a4e45a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:15.732282 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-32ad09ed-b21e-4d96-8a3e-c36f05a4e45a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:15.733069 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-32ad09ed-b21e-4d96-8a3e-c36f05a4e45a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:15.733566 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-32ad09ed-b21e-4d96-8a3e-c36f05a4e45a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:15.734171 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-32ad09ed-b21e-4d96-8a3e-c36f05a4e45a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:15.779955 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-8271e3ce-99c4-4d98-8196-1722a1467675 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:15.780604 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-8271e3ce-99c4-4d98-8196-1722a1467675 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:15.788348 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8271e3ce-99c4-4d98-8196-1722a1467675 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:15.788845 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8271e3ce-99c4-4d98-8196-1722a1467675 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:15.789275 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8271e3ce-99c4-4d98-8196-1722a1467675 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:15.790012 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8271e3ce-99c4-4d98-8196-1722a1467675 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:15.790466 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8271e3ce-99c4-4d98-8196-1722a1467675 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:15.790887 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8271e3ce-99c4-4d98-8196-1722a1467675 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:15.815865 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:15.952438 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-32ad09ed-b21e-4d96-8a3e-c36f05a4e45a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:15.962975 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-32ad09ed-b21e-4d96-8a3e-c36f05a4e45a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f" status: 200 len: 1313 microversion: 2.1 time: 0.246625 Aug 19 21:12:15.964919 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 216/400] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:15 2022] GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:12:15.994193 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-8271e3ce-99c4-4d98-8196-1722a1467675 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:16.003372 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-8271e3ce-99c4-4d98-8196-1722a1467675 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:16.006044 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-8271e3ce-99c4-4d98-8196-1722a1467675 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:16.007439 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-8271e3ce-99c4-4d98-8196-1722a1467675 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1722 microversion: 2.20 time: 0.231447 Aug 19 21:12:16.008068 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 185/401] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:15 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:12:16.236137 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-69a0793e-70c1-450d-a387-f6b73a49e8c4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:16.236636 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-69a0793e-70c1-450d-a387-f6b73a49e8c4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:16.239037 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=4 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:16.248644 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-69a0793e-70c1-450d-a387-f6b73a49e8c4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:16.249166 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-69a0793e-70c1-450d-a387-f6b73a49e8c4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:16.249598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-69a0793e-70c1-450d-a387-f6b73a49e8c4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:16.250367 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-69a0793e-70c1-450d-a387-f6b73a49e8c4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:16.250829 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-69a0793e-70c1-450d-a387-f6b73a49e8c4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:16.251255 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-69a0793e-70c1-450d-a387-f6b73a49e8c4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:16.282602 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-69a0793e-70c1-450d-a387-f6b73a49e8c4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e/ips" status: 200 len: 146 microversion: 2.1 time: 0.050296 Aug 19 21:12:16.283195 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 217/402] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Aug 19 21:12:16 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e/ips => generated 146 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:12:16.993809 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-022fe30c-2d30-4667-8a0f-21fe2b8bc46a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:16.994475 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-022fe30c-2d30-4667-8a0f-21fe2b8bc46a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: df7f52d4-35a4-4f3f-8740-ed6002a4e62f] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:17.001167 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-022fe30c-2d30-4667-8a0f-21fe2b8bc46a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:17.001654 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-022fe30c-2d30-4667-8a0f-21fe2b8bc46a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:17.002114 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-022fe30c-2d30-4667-8a0f-21fe2b8bc46a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:17.002822 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-022fe30c-2d30-4667-8a0f-21fe2b8bc46a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:17.003273 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-022fe30c-2d30-4667-8a0f-21fe2b8bc46a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:17.003697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-022fe30c-2d30-4667-8a0f-21fe2b8bc46a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:17.037079 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-af4a9ef6-8469-4b6d-8eab-be87286bef17 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:17.038072 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-af4a9ef6-8469-4b6d-8eab-be87286bef17 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:17.045086 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-af4a9ef6-8469-4b6d-8eab-be87286bef17 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:17.045755 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-af4a9ef6-8469-4b6d-8eab-be87286bef17 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:17.046304 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-af4a9ef6-8469-4b6d-8eab-be87286bef17 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:17.047246 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-af4a9ef6-8469-4b6d-8eab-be87286bef17 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:17.047741 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-af4a9ef6-8469-4b6d-8eab-be87286bef17 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:17.048172 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-af4a9ef6-8469-4b6d-8eab-be87286bef17 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:17.243484 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-022fe30c-2d30-4667-8a0f-21fe2b8bc46a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:17.256440 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-022fe30c-2d30-4667-8a0f-21fe2b8bc46a tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f" status: 200 len: 1313 microversion: 2.1 time: 0.267276 Aug 19 21:12:17.257092 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 186/403] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:16 2022] GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:17.263743 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-8f246956-6e5d-4ce5-94cc-1213ba030c27 req-34d38638-bba2-4068-b8cb-bff7af404b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df7f52d4-35a4-4f3f-8740-ed6002a4e62f", "name": "network-vif-plugged", "status": "completed", "tag": "808ad7a8-7f08-47ac-ad42-742a0b87689e"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:12:17.267385 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-af4a9ef6-8469-4b6d-8eab-be87286bef17 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:17.278591 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-af4a9ef6-8469-4b6d-8eab-be87286bef17 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:17.280893 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-8f246956-6e5d-4ce5-94cc-1213ba030c27 req-34d38638-bba2-4068-b8cb-bff7af404b98 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:17.281366 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-8f246956-6e5d-4ce5-94cc-1213ba030c27 req-34d38638-bba2-4068-b8cb-bff7af404b98 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:17.281608 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-af4a9ef6-8469-4b6d-8eab-be87286bef17 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:17.281835 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-8f246956-6e5d-4ce5-94cc-1213ba030c27 req-34d38638-bba2-4068-b8cb-bff7af404b98 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:17.284024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-af4a9ef6-8469-4b6d-8eab-be87286bef17 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1722 microversion: 2.20 time: 0.255082 Aug 19 21:12:17.285151 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 218/404] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:17 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:17.293730 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-8f246956-6e5d-4ce5-94cc-1213ba030c27 req-34d38638-bba2-4068-b8cb-bff7af404b98 service nova] Creating event network-vif-plugged:808ad7a8-7f08-47ac-ad42-742a0b87689e for instance df7f52d4-35a4-4f3f-8740-ed6002a4e62f on hv-cinder-85220 Aug 19 21:12:17.305494 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-8f246956-6e5d-4ce5-94cc-1213ba030c27 req-34d38638-bba2-4068-b8cb-bff7af404b98 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045571 Aug 19 21:12:17.306215 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 187/405] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:12:18.277625 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-67d01a16-4924-4f4c-abf6-b4203047c445 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:18.278278 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-67d01a16-4924-4f4c-abf6-b4203047c445 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: df7f52d4-35a4-4f3f-8740-ed6002a4e62f] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:18.284836 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-67d01a16-4924-4f4c-abf6-b4203047c445 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:18.285390 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-67d01a16-4924-4f4c-abf6-b4203047c445 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:18.285902 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-67d01a16-4924-4f4c-abf6-b4203047c445 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:18.286817 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-67d01a16-4924-4f4c-abf6-b4203047c445 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:18.287266 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-67d01a16-4924-4f4c-abf6-b4203047c445 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:18.287687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-67d01a16-4924-4f4c-abf6-b4203047c445 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:18.309870 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-b4b07503-a08f-4be5-8ce6-6152e8f992ba tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:18.310512 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-b4b07503-a08f-4be5-8ce6-6152e8f992ba tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:18.317540 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b4b07503-a08f-4be5-8ce6-6152e8f992ba tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:18.318568 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b4b07503-a08f-4be5-8ce6-6152e8f992ba tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:18.319016 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b4b07503-a08f-4be5-8ce6-6152e8f992ba tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:18.319716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b4b07503-a08f-4be5-8ce6-6152e8f992ba tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:18.320289 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b4b07503-a08f-4be5-8ce6-6152e8f992ba tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:18.320591 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b4b07503-a08f-4be5-8ce6-6152e8f992ba tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:18.488247 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-67d01a16-4924-4f4c-abf6-b4203047c445 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:18.497910 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-67d01a16-4924-4f4c-abf6-b4203047c445 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f" status: 200 len: 1313 microversion: 2.1 time: 0.223966 Aug 19 21:12:18.498675 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 219/406] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:18 2022] GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:18.523087 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b4b07503-a08f-4be5-8ce6-6152e8f992ba tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:18.538959 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b4b07503-a08f-4be5-8ce6-6152e8f992ba tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:18.541992 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b4b07503-a08f-4be5-8ce6-6152e8f992ba tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:18.543534 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-b4b07503-a08f-4be5-8ce6-6152e8f992ba tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1722 microversion: 2.20 time: 0.238414 Aug 19 21:12:18.544098 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 188/407] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:18 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:12:18.640610 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-4001dc6d-9230-420a-b56b-afb7d6707d0a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68ecec5e-f2a3-41f9-a50a-f9c110281fe3"}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:12:18.642960 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-4001dc6d-9230-420a-b56b-afb7d6707d0a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:18.648948 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4001dc6d-9230-420a-b56b-afb7d6707d0a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:18.649432 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4001dc6d-9230-420a-b56b-afb7d6707d0a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:18.649902 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4001dc6d-9230-420a-b56b-afb7d6707d0a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:18.650596 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4001dc6d-9230-420a-b56b-afb7d6707d0a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:18.651049 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4001dc6d-9230-420a-b56b-afb7d6707d0a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:18.651471 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4001dc6d-9230-420a-b56b-afb7d6707d0a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:18.850401 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:18.984930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-4001dc6d-9230-420a-b56b-afb7d6707d0a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "POST /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.348103 Aug 19 21:12:18.985532 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 220/408] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Aug 19 21:12:18 2022] POST /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:12:19.519464 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-8de42468-2c26-40ab-9a65-c65ba8902c99 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:19.520115 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-8de42468-2c26-40ab-9a65-c65ba8902c99 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: df7f52d4-35a4-4f3f-8740-ed6002a4e62f] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:19.527479 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8de42468-2c26-40ab-9a65-c65ba8902c99 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:19.527967 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8de42468-2c26-40ab-9a65-c65ba8902c99 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:19.528394 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8de42468-2c26-40ab-9a65-c65ba8902c99 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:19.529096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8de42468-2c26-40ab-9a65-c65ba8902c99 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:19.529543 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8de42468-2c26-40ab-9a65-c65ba8902c99 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:19.530003 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8de42468-2c26-40ab-9a65-c65ba8902c99 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:19.568943 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ce6ec6fb-bb11-4b3c-8905-96ba4dcd568d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:19.569757 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ce6ec6fb-bb11-4b3c-8905-96ba4dcd568d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:19.577257 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce6ec6fb-bb11-4b3c-8905-96ba4dcd568d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:19.577782 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce6ec6fb-bb11-4b3c-8905-96ba4dcd568d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:19.578237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce6ec6fb-bb11-4b3c-8905-96ba4dcd568d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:19.578968 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce6ec6fb-bb11-4b3c-8905-96ba4dcd568d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:19.579437 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce6ec6fb-bb11-4b3c-8905-96ba4dcd568d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:19.579880 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce6ec6fb-bb11-4b3c-8905-96ba4dcd568d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:19.748751 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-8de42468-2c26-40ab-9a65-c65ba8902c99 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:19.762205 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-8de42468-2c26-40ab-9a65-c65ba8902c99 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f" status: 200 len: 1498 microversion: 2.1 time: 0.246511 Aug 19 21:12:19.766544 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 189/409] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:19 2022] GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f => generated 1498 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:19.809908 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ce6ec6fb-bb11-4b3c-8905-96ba4dcd568d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:19.820254 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ce6ec6fb-bb11-4b3c-8905-96ba4dcd568d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:19.821999 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ce6ec6fb-bb11-4b3c-8905-96ba4dcd568d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:19.823420 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ce6ec6fb-bb11-4b3c-8905-96ba4dcd568d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1722 microversion: 2.20 time: 0.260405 Aug 19 21:12:19.824202 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 221/410] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:19 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:12:20.350661 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-67246716-d939-4b45-afc2-ac1d63e9c66b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:20.351169 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-67246716-d939-4b45-afc2-ac1d63e9c66b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: df7f52d4-35a4-4f3f-8740-ed6002a4e62f] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:20.358074 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-67246716-d939-4b45-afc2-ac1d63e9c66b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:20.358651 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-67246716-d939-4b45-afc2-ac1d63e9c66b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:20.359093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-67246716-d939-4b45-afc2-ac1d63e9c66b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:20.359799 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-67246716-d939-4b45-afc2-ac1d63e9c66b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:20.360432 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-67246716-d939-4b45-afc2-ac1d63e9c66b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:20.361024 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-67246716-d939-4b45-afc2-ac1d63e9c66b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:20.397150 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-67246716-d939-4b45-afc2-ac1d63e9c66b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: df7f52d4-35a4-4f3f-8740-ed6002a4e62f] Going to try to terminate instance {{(pid=120876) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 21:12:20.488184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-67246716-d939-4b45-afc2-ac1d63e9c66b tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "DELETE /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f" status: 204 len: 0 microversion: 2.1 time: 0.141448 Aug 19 21:12:20.489706 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 190/411] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:12:20 2022] DELETE /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 19 21:12:20.501841 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a4aa35a6-1496-4640-aa13-637af4e2310c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:20.502906 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-a4aa35a6-1496-4640-aa13-637af4e2310c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: df7f52d4-35a4-4f3f-8740-ed6002a4e62f] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:20.518692 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a4aa35a6-1496-4640-aa13-637af4e2310c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:20.521368 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a4aa35a6-1496-4640-aa13-637af4e2310c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:20.522161 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a4aa35a6-1496-4640-aa13-637af4e2310c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:20.523467 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a4aa35a6-1496-4640-aa13-637af4e2310c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:20.524275 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a4aa35a6-1496-4640-aa13-637af4e2310c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:20.525045 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a4aa35a6-1496-4640-aa13-637af4e2310c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:20.733450 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-a4aa35a6-1496-4640-aa13-637af4e2310c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:20.742196 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-a4aa35a6-1496-4640-aa13-637af4e2310c tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f" status: 200 len: 1504 microversion: 2.1 time: 0.247217 Aug 19 21:12:20.742786 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 222/412] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:20 2022] GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f => generated 1504 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:20.846978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-9f31e1f1-4e63-4848-938e-4e828144be2b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:20.847739 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-9f31e1f1-4e63-4848-938e-4e828144be2b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:20.854923 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9f31e1f1-4e63-4848-938e-4e828144be2b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:20.855484 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9f31e1f1-4e63-4848-938e-4e828144be2b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:20.856000 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9f31e1f1-4e63-4848-938e-4e828144be2b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:20.856940 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9f31e1f1-4e63-4848-938e-4e828144be2b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:20.857544 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9f31e1f1-4e63-4848-938e-4e828144be2b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:20.858187 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9f31e1f1-4e63-4848-938e-4e828144be2b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:21.016635 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9f31e1f1-4e63-4848-938e-4e828144be2b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:21.034124 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9f31e1f1-4e63-4848-938e-4e828144be2b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:21.035855 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9f31e1f1-4e63-4848-938e-4e828144be2b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:21.037099 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-9f31e1f1-4e63-4848-938e-4e828144be2b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1722 microversion: 2.20 time: 0.194534 Aug 19 21:12:21.037740 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 191/413] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:20 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:21.772500 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-af99a0ea-67a4-46db-bcc8-7eaf98d4fe94 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:21.773278 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-af99a0ea-67a4-46db-bcc8-7eaf98d4fe94 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: df7f52d4-35a4-4f3f-8740-ed6002a4e62f] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:21.780377 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-af99a0ea-67a4-46db-bcc8-7eaf98d4fe94 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:21.780862 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-af99a0ea-67a4-46db-bcc8-7eaf98d4fe94 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:21.781320 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-af99a0ea-67a4-46db-bcc8-7eaf98d4fe94 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:21.782135 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-af99a0ea-67a4-46db-bcc8-7eaf98d4fe94 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:21.782755 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-af99a0ea-67a4-46db-bcc8-7eaf98d4fe94 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:21.783297 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-af99a0ea-67a4-46db-bcc8-7eaf98d4fe94 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:21.931516 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-af99a0ea-67a4-46db-bcc8-7eaf98d4fe94 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:21.942144 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-af99a0ea-67a4-46db-bcc8-7eaf98d4fe94 tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f" status: 200 len: 1504 microversion: 2.1 time: 0.174090 Aug 19 21:12:21.954521 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 223/414] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:21 2022] GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:22.074661 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-fc537d63-ac14-4925-9f17-cd0ba86f2dbf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:22.075276 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-fc537d63-ac14-4925-9f17-cd0ba86f2dbf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:22.081921 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fc537d63-ac14-4925-9f17-cd0ba86f2dbf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:22.083026 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fc537d63-ac14-4925-9f17-cd0ba86f2dbf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:22.083464 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fc537d63-ac14-4925-9f17-cd0ba86f2dbf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:22.084175 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fc537d63-ac14-4925-9f17-cd0ba86f2dbf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:22.084636 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fc537d63-ac14-4925-9f17-cd0ba86f2dbf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:22.085059 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fc537d63-ac14-4925-9f17-cd0ba86f2dbf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:22.244174 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-fc537d63-ac14-4925-9f17-cd0ba86f2dbf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:22.252953 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-fc537d63-ac14-4925-9f17-cd0ba86f2dbf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:22.255118 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-fc537d63-ac14-4925-9f17-cd0ba86f2dbf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:22.256334 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-fc537d63-ac14-4925-9f17-cd0ba86f2dbf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1722 microversion: 2.20 time: 0.185657 Aug 19 21:12:22.256895 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 192/415] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:22 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:22.966566 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-9e55a355-48ef-48f2-95f7-295adca311fc tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:22.967189 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-9e55a355-48ef-48f2-95f7-295adca311fc tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: df7f52d4-35a4-4f3f-8740-ed6002a4e62f] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:22.975300 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9e55a355-48ef-48f2-95f7-295adca311fc tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:22.977911 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9e55a355-48ef-48f2-95f7-295adca311fc tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:22.977911 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9e55a355-48ef-48f2-95f7-295adca311fc tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:22.977911 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9e55a355-48ef-48f2-95f7-295adca311fc tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:22.977911 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9e55a355-48ef-48f2-95f7-295adca311fc tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:22.978302 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9e55a355-48ef-48f2-95f7-295adca311fc tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:22.995721 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-42916569-c211-4248-8bd5-25d355423958 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:22.997507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-42916569-c211-4248-8bd5-25d355423958 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:23.003638 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:23.011334 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-42916569-c211-4248-8bd5-25d355423958 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:23.012885 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-42916569-c211-4248-8bd5-25d355423958 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:23.013483 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-42916569-c211-4248-8bd5-25d355423958 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:23.014265 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-42916569-c211-4248-8bd5-25d355423958 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:23.014902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-42916569-c211-4248-8bd5-25d355423958 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:23.015325 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-42916569-c211-4248-8bd5-25d355423958 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:23.282673 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-9e55a355-48ef-48f2-95f7-295adca311fc tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0576905fd534e1ead96f5da9a817bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c600e063ecf4490087703e6f9c87cefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:23.294058 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-9e55a355-48ef-48f2-95f7-295adca311fc tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f" status: 200 len: 1504 microversion: 2.1 time: 0.332325 Aug 19 21:12:23.294539 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 224/416] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:22 2022] GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f => generated 1504 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:23.301959 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-d36e9921-6124-4a57-bf6b-83dfe8fc5ea6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:23.306796 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-d36e9921-6124-4a57-bf6b-83dfe8fc5ea6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:23.329735 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d36e9921-6124-4a57-bf6b-83dfe8fc5ea6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:23.329735 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d36e9921-6124-4a57-bf6b-83dfe8fc5ea6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:23.329735 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d36e9921-6124-4a57-bf6b-83dfe8fc5ea6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:23.330162 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-42916569-c211-4248-8bd5-25d355423958 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:23.330596 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d36e9921-6124-4a57-bf6b-83dfe8fc5ea6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:23.330596 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d36e9921-6124-4a57-bf6b-83dfe8fc5ea6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:23.331020 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d36e9921-6124-4a57-bf6b-83dfe8fc5ea6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:23.361475 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-42916569-c211-4248-8bd5-25d355423958 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1595 microversion: 2.1 time: 0.372940 Aug 19 21:12:23.362486 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 193/417] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:22 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1595 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:23.505789 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-c07da6c5-c983-4677-98fb-5d39183b0ab7 req-b5b83616-c2b2-4759-a9bd-9c22c69fccc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df7f52d4-35a4-4f3f-8740-ed6002a4e62f", "name": "network-vif-deleted", "tag": "808ad7a8-7f08-47ac-ad42-742a0b87689e"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:12:23.525345 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-c07da6c5-c983-4677-98fb-5d39183b0ab7 req-b5b83616-c2b2-4759-a9bd-9c22c69fccc9 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:23.526198 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-c07da6c5-c983-4677-98fb-5d39183b0ab7 req-b5b83616-c2b2-4759-a9bd-9c22c69fccc9 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:23.526879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-c07da6c5-c983-4677-98fb-5d39183b0ab7 req-b5b83616-c2b2-4759-a9bd-9c22c69fccc9 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:23.546423 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-c07da6c5-c983-4677-98fb-5d39183b0ab7 req-b5b83616-c2b2-4759-a9bd-9c22c69fccc9 service nova] Creating event network-vif-deleted:808ad7a8-7f08-47ac-ad42-742a0b87689e for instance df7f52d4-35a4-4f3f-8740-ed6002a4e62f on hv-cinder-85220 Aug 19 21:12:23.554545 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-c07da6c5-c983-4677-98fb-5d39183b0ab7 req-b5b83616-c2b2-4759-a9bd-9c22c69fccc9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052938 Aug 19 21:12:23.556257 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 194/418] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:12:23.600363 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-d36e9921-6124-4a57-bf6b-83dfe8fc5ea6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:23.616350 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-d36e9921-6124-4a57-bf6b-83dfe8fc5ea6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:23.617995 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-d36e9921-6124-4a57-bf6b-83dfe8fc5ea6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:23.619215 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-d36e9921-6124-4a57-bf6b-83dfe8fc5ea6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1722 microversion: 2.20 time: 0.321826 Aug 19 21:12:23.634132 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 225/419] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:23 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1722 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:24.332041 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-fc6314a7-cc6b-46c0-9fa2-3d50b6ea4ecb tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:24.333193 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-fc6314a7-cc6b-46c0-9fa2-3d50b6ea4ecb tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] [instance: df7f52d4-35a4-4f3f-8740-ed6002a4e62f] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:24.341231 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fc6314a7-cc6b-46c0-9fa2-3d50b6ea4ecb tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:24.341786 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fc6314a7-cc6b-46c0-9fa2-3d50b6ea4ecb tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:24.342238 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fc6314a7-cc6b-46c0-9fa2-3d50b6ea4ecb tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:24.343112 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fc6314a7-cc6b-46c0-9fa2-3d50b6ea4ecb tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:24.343580 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fc6314a7-cc6b-46c0-9fa2-3d50b6ea4ecb tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:24.344009 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fc6314a7-cc6b-46c0-9fa2-3d50b6ea4ecb tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:24.358521 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-fc6314a7-cc6b-46c0-9fa2-3d50b6ea4ecb tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] HTTP exception thrown: Instance df7f52d4-35a4-4f3f-8740-ed6002a4e62f could not be found. Aug 19 21:12:24.360600 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-fc6314a7-cc6b-46c0-9fa2-3d50b6ea4ecb tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Request method failure captured: Aug 19 21:12:24.360600 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f HTTP/1.1 Aug 19 21:12:24.360600 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:12:24.360600 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:12:24.360600 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:12:24.360600 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:12:24.360600 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:12:24.360600 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:12:24.360600 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:12:24.360600 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:12:24.360600 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__xw3LimdGnnyTz-Y4fTVtqyDXJejGeZlQoDPhn3Cny6RtoKB1SGmJqpDkFVQGoFmra-7wYRtJWHgf8yKh2tSgk-8RjPy3lr8dpKmyuPIt4OVE6T7zj6Zl5zRqrx8g3F7DbrVa7yAuf7CqbMjnbiwvznzaF2wbeo8VgNckDy0OM-ksQ Aug 19 21:12:24.360600 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:12:24.360600 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:12:24.360600 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:12:24.360600 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:12:24.360600 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:12:24.360600 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:12:24.360600 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: c600e063ecf4490087703e6f9c87cefb Aug 19 21:12:24.360600 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-VolumesActionsTest-894176538 Aug 19 21:12:24.360600 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:12:24.360600 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:12:24.361978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c600e063ecf4490087703e6f9c87cefb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c600e063ecf4490087703e6f9c87cefb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c600e063ecf4490087703e6f9c87cefb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c600e063ecf4490087703e6f9c87cefb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:12:24.361978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-VolumesActionsTest-894176538 Aug 19 21:12:24.361978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: c600e063ecf4490087703e6f9c87cefb Aug 19 21:12:24.361978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-VolumesActionsTest-894176538 Aug 19 21:12:24.361978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-VolumesActionsTest-894176538-project Aug 19 21:12:24.361978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:12:24.361978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:12:24.361978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: d0576905fd534e1ead96f5da9a817bb7 Aug 19 21:12:24.361978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-VolumesActionsTest-894176538-project Aug 19 21:12:24.361978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: > Aug 19 21:12:24.361978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Instance df7f52d4-35a4-4f3f-8740-ed6002a4e62f could not be found. Aug 19 21:12:24.361978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': 'df7f52d4-35a4-4f3f-8740-ed6002a4e62f'} Aug 19 21:12:24.362873 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:12:24.362873 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:12:24.362873 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:12:24.362873 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:12:24.362873 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:12:24.362873 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:12:24.362873 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:12:24.362873 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:12:24.362873 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:12:24.362873 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:12:24.362873 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df7f52d4-35a4-4f3f-8740-ed6002a4e62f could not be found. Aug 19 21:12:24.362873 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:12:24.362873 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:12:24.362873 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:12:24.362873 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:12:24.362873 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:12:24.362873 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:12:24.362873 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:12:24.362873 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:12:24.362873 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:12:24.364157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:12:24.364157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:12:24.364157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:12:24.364157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:12:24.364157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:12:24.364157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:12:24.364157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:12:24.364157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df7f52d4-35a4-4f3f-8740-ed6002a4e62f could not be found. Aug 19 21:12:24.364157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:12:24.364157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:12:24.364157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:12:24.364157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:12:24.364157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:12:24.364157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:12:24.364157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:12:24.364157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:12:24.364157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df7f52d4-35a4-4f3f-8740-ed6002a4e62f could not be found. Aug 19 21:12:24.364157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:12:24.365459 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-fc6314a7-cc6b-46c0-9fa2-3d50b6ea4ecb tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] Returning 404 to user: Instance df7f52d4-35a4-4f3f-8740-ed6002a4e62f could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:12:24.365459 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-fc6314a7-cc6b-46c0-9fa2-3d50b6ea4ecb tempest-VolumesActionsTest-894176538 tempest-VolumesActionsTest-894176538-project] 10.222.0.16 "GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f" status: 404 len: 111 microversion: 2.1 time: 0.035065 Aug 19 21:12:24.368316 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 195/420] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:24 2022] GET /compute/v2.1/servers/df7f52d4-35a4-4f3f-8740-ed6002a4e62f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:12:24.661123 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-12eeca70-7bdb-4201-8b17-c0fca1de3ec4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:24.662521 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-12eeca70-7bdb-4201-8b17-c0fca1de3ec4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:24.669544 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-12eeca70-7bdb-4201-8b17-c0fca1de3ec4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:24.670156 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-12eeca70-7bdb-4201-8b17-c0fca1de3ec4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:24.670803 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-12eeca70-7bdb-4201-8b17-c0fca1de3ec4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:24.671528 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-12eeca70-7bdb-4201-8b17-c0fca1de3ec4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:24.671991 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-12eeca70-7bdb-4201-8b17-c0fca1de3ec4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:24.672426 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-12eeca70-7bdb-4201-8b17-c0fca1de3ec4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:24.856421 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-12eeca70-7bdb-4201-8b17-c0fca1de3ec4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:24.867040 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-12eeca70-7bdb-4201-8b17-c0fca1de3ec4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:24.868647 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-12eeca70-7bdb-4201-8b17-c0fca1de3ec4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:24.870106 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-12eeca70-7bdb-4201-8b17-c0fca1de3ec4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1722 microversion: 2.20 time: 0.214099 Aug 19 21:12:24.870931 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 226/421] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:24 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:25.533810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-9e52822e-c10c-435b-917b-26f7d6c792c9 req-8c97eb1b-a342-48fc-8c20-a5b2d808c00e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea09e576-f3ee-4b10-813f-23574635c10c", "tag": "dc06a7d7-d9fe-4dd6-8dab-d1c3f12f11f3"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:12:25.546642 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-9e52822e-c10c-435b-917b-26f7d6c792c9 req-8c97eb1b-a342-48fc-8c20-a5b2d808c00e service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:25.547498 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-9e52822e-c10c-435b-917b-26f7d6c792c9 req-8c97eb1b-a342-48fc-8c20-a5b2d808c00e service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:25.547932 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-9e52822e-c10c-435b-917b-26f7d6c792c9 req-8c97eb1b-a342-48fc-8c20-a5b2d808c00e service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:25.562279 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-9e52822e-c10c-435b-917b-26f7d6c792c9 req-8c97eb1b-a342-48fc-8c20-a5b2d808c00e service nova] Creating event network-changed:dc06a7d7-d9fe-4dd6-8dab-d1c3f12f11f3 for instance ea09e576-f3ee-4b10-813f-23574635c10c on hv-cinder-85220 Aug 19 21:12:25.569315 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-9e52822e-c10c-435b-917b-26f7d6c792c9 req-8c97eb1b-a342-48fc-8c20-a5b2d808c00e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039237 Aug 19 21:12:25.569964 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 196/422] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:12:25.894901 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3edb3989-ef2c-44c9-8ec2-b79e7c02b829 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:25.896503 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-3edb3989-ef2c-44c9-8ec2-b79e7c02b829 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:25.903424 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3edb3989-ef2c-44c9-8ec2-b79e7c02b829 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:25.904324 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3edb3989-ef2c-44c9-8ec2-b79e7c02b829 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:25.904980 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3edb3989-ef2c-44c9-8ec2-b79e7c02b829 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:25.906180 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3edb3989-ef2c-44c9-8ec2-b79e7c02b829 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:25.906909 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3edb3989-ef2c-44c9-8ec2-b79e7c02b829 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:25.907565 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3edb3989-ef2c-44c9-8ec2-b79e7c02b829 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:26.080213 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3edb3989-ef2c-44c9-8ec2-b79e7c02b829 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:26.097001 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3edb3989-ef2c-44c9-8ec2-b79e7c02b829 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:26.103572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3edb3989-ef2c-44c9-8ec2-b79e7c02b829 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:26.105643 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-3edb3989-ef2c-44c9-8ec2-b79e7c02b829 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1722 microversion: 2.20 time: 0.214378 Aug 19 21:12:26.107032 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 227/423] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:25 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:26.922372 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-c236cbd3-7eb2-4fec-9429-fc6062eb9b50 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1911929329"}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:12:26.923399 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-c236cbd3-7eb2-4fec-9429-fc6062eb9b50 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:26.932342 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c236cbd3-7eb2-4fec-9429-fc6062eb9b50 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:26.932923 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c236cbd3-7eb2-4fec-9429-fc6062eb9b50 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:26.933432 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c236cbd3-7eb2-4fec-9429-fc6062eb9b50 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:26.934246 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c236cbd3-7eb2-4fec-9429-fc6062eb9b50 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:26.934761 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c236cbd3-7eb2-4fec-9429-fc6062eb9b50 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:26.935245 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c236cbd3-7eb2-4fec-9429-fc6062eb9b50 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:27.097886 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.network.security_group_api [None req-c236cbd3-7eb2-4fec-9429-fc6062eb9b50 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Adding security group 15909ec0-52a2-48d5-a5bb-eebec0ea9005 to port dc06a7d7-d9fe-4dd6-8dab-d1c3f12f11f3 Aug 19 21:12:27.133101 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-bd6d9440-f75b-4368-9f39-183c53778605 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:27.133731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-bd6d9440-f75b-4368-9f39-183c53778605 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:27.140943 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bd6d9440-f75b-4368-9f39-183c53778605 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:27.141441 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bd6d9440-f75b-4368-9f39-183c53778605 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:27.141922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bd6d9440-f75b-4368-9f39-183c53778605 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:27.142637 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bd6d9440-f75b-4368-9f39-183c53778605 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:27.143282 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bd6d9440-f75b-4368-9f39-183c53778605 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:27.143706 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bd6d9440-f75b-4368-9f39-183c53778605 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:27.354159 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-bd6d9440-f75b-4368-9f39-183c53778605 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:27.364320 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-bd6d9440-f75b-4368-9f39-183c53778605 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:27.366393 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-bd6d9440-f75b-4368-9f39-183c53778605 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:27.367692 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-bd6d9440-f75b-4368-9f39-183c53778605 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1722 microversion: 2.20 time: 0.239569 Aug 19 21:12:27.368351 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 228/424] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:27 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:12:27.543940 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-c236cbd3-7eb2-4fec-9429-fc6062eb9b50 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "POST /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c/action" status: 202 len: 0 microversion: 2.1 time: 0.628153 Aug 19 21:12:27.547576 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 197/425] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Aug 19 21:12:26 2022] POST /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:12:27.559382 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-df5f2365-932c-46a4-9ff9-4e8b10376a44 req-8b7fdb5c-75eb-4b1c-8b17-b58fa0c4f83d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea09e576-f3ee-4b10-813f-23574635c10c", "tag": "dc06a7d7-d9fe-4dd6-8dab-d1c3f12f11f3"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:12:27.562482 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-02e60a3f-f268-4752-acdf-bed2f78d63af tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:27.563581 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-02e60a3f-f268-4752-acdf-bed2f78d63af tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:27.576590 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-02e60a3f-f268-4752-acdf-bed2f78d63af tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:27.577364 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-02e60a3f-f268-4752-acdf-bed2f78d63af tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:27.578156 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-02e60a3f-f268-4752-acdf-bed2f78d63af tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:27.579601 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-02e60a3f-f268-4752-acdf-bed2f78d63af tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:27.580458 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-02e60a3f-f268-4752-acdf-bed2f78d63af tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:27.581234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-02e60a3f-f268-4752-acdf-bed2f78d63af tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:27.584438 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-df5f2365-932c-46a4-9ff9-4e8b10376a44 req-8b7fdb5c-75eb-4b1c-8b17-b58fa0c4f83d service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:27.585545 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-df5f2365-932c-46a4-9ff9-4e8b10376a44 req-8b7fdb5c-75eb-4b1c-8b17-b58fa0c4f83d service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:27.586512 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-df5f2365-932c-46a4-9ff9-4e8b10376a44 req-8b7fdb5c-75eb-4b1c-8b17-b58fa0c4f83d service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:27.620362 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-df5f2365-932c-46a4-9ff9-4e8b10376a44 req-8b7fdb5c-75eb-4b1c-8b17-b58fa0c4f83d service nova] Creating event network-changed:dc06a7d7-d9fe-4dd6-8dab-d1c3f12f11f3 for instance ea09e576-f3ee-4b10-813f-23574635c10c on hv-cinder-85220 Aug 19 21:12:27.625911 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-df5f2365-932c-46a4-9ff9-4e8b10376a44 req-8b7fdb5c-75eb-4b1c-8b17-b58fa0c4f83d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077046 Aug 19 21:12:27.626622 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 229/426] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:12:27.762487 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-02e60a3f-f268-4752-acdf-bed2f78d63af tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:27.771935 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-02e60a3f-f268-4752-acdf-bed2f78d63af tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1642 microversion: 2.1 time: 0.217509 Aug 19 21:12:27.772809 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 198/427] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:27 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1642 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:12:28.416031 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-1088e642-6e11-4069-9d5e-efca8f3a0f90 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:28.418779 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-1088e642-6e11-4069-9d5e-efca8f3a0f90 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:28.429715 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1088e642-6e11-4069-9d5e-efca8f3a0f90 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:28.430462 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1088e642-6e11-4069-9d5e-efca8f3a0f90 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:28.431058 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1088e642-6e11-4069-9d5e-efca8f3a0f90 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:28.431934 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1088e642-6e11-4069-9d5e-efca8f3a0f90 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:28.432857 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1088e642-6e11-4069-9d5e-efca8f3a0f90 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:28.433464 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1088e642-6e11-4069-9d5e-efca8f3a0f90 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:28.590993 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-1088e642-6e11-4069-9d5e-efca8f3a0f90 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:28.600814 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-1088e642-6e11-4069-9d5e-efca8f3a0f90 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:28.602363 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-1088e642-6e11-4069-9d5e-efca8f3a0f90 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:28.603755 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-1088e642-6e11-4069-9d5e-efca8f3a0f90 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1722 microversion: 2.20 time: 0.198027 Aug 19 21:12:28.604329 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 230/428] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:28 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:29.631926 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-304457f6-e307-4fd4-906a-205784d773d6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:29.632541 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-304457f6-e307-4fd4-906a-205784d773d6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:29.639336 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-304457f6-e307-4fd4-906a-205784d773d6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:29.639822 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-304457f6-e307-4fd4-906a-205784d773d6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:29.640248 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-304457f6-e307-4fd4-906a-205784d773d6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:29.640941 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-304457f6-e307-4fd4-906a-205784d773d6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:29.641386 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-304457f6-e307-4fd4-906a-205784d773d6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:29.641825 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-304457f6-e307-4fd4-906a-205784d773d6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:29.788409 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-304457f6-e307-4fd4-906a-205784d773d6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:29.796896 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-304457f6-e307-4fd4-906a-205784d773d6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:29.798447 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-304457f6-e307-4fd4-906a-205784d773d6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:29.799609 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-304457f6-e307-4fd4-906a-205784d773d6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1722 microversion: 2.20 time: 0.172660 Aug 19 21:12:29.800194 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 199/429] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:29 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:30.826612 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-90a6c8e2-06d7-407c-9627-f1c2962e893b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:30.827222 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-90a6c8e2-06d7-407c-9627-f1c2962e893b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:30.834188 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-90a6c8e2-06d7-407c-9627-f1c2962e893b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:30.834679 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-90a6c8e2-06d7-407c-9627-f1c2962e893b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:30.835120 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-90a6c8e2-06d7-407c-9627-f1c2962e893b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:30.835824 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-90a6c8e2-06d7-407c-9627-f1c2962e893b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:30.836286 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-90a6c8e2-06d7-407c-9627-f1c2962e893b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:30.836712 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-90a6c8e2-06d7-407c-9627-f1c2962e893b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:30.974140 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-90a6c8e2-06d7-407c-9627-f1c2962e893b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:30.982784 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-90a6c8e2-06d7-407c-9627-f1c2962e893b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:30.984301 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-90a6c8e2-06d7-407c-9627-f1c2962e893b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:30.985492 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-90a6c8e2-06d7-407c-9627-f1c2962e893b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1722 microversion: 2.20 time: 0.162898 Aug 19 21:12:30.986092 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 231/430] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:30 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:31.838300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-9269fe8b-d879-4b6d-b0e5-111091923fb3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Action: 'create', calling method: .version_select at 0x7f740be20790>, body: {"keypair": {"name": "tempest-keypair-612838023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNifHZYAWiuL0Gze3DMc/Ae1SC9akw/y71prq2u30QiNIwX2Or1z3NF7rJ8HGjzo1HajFljXnOzSvmBwoOUd4vi/Won6sGZHYb++IAX/nCb6WvHOyZaPo5Njsnl92kbBjA=="}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:12:31.877416 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-9269fe8b-d879-4b6d-b0e5-111091923fb3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Getting quotas for project 358e50f9b9df43b7aa0a4ba1353e4a25. Resources: {'key_pairs'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:12:31.885380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-9269fe8b-d879-4b6d-b0e5-111091923fb3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Getting quotas for user 7f46019e78cc4e89bf877a4f5a7a8fe9 and project 358e50f9b9df43b7aa0a4ba1353e4a25. Resources: {'key_pairs'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:12:31.939532 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-9269fe8b-d879-4b6d-b0e5-111091923fb3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.107011 Aug 19 21:12:31.947746 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 200/431] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Aug 19 21:12:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:12:32.010832 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e08af2e2-3fb5-498f-838d-e404e344a170 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:32.011625 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-e08af2e2-3fb5-498f-838d-e404e344a170 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:32.036162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e08af2e2-3fb5-498f-838d-e404e344a170 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:32.036907 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e08af2e2-3fb5-498f-838d-e404e344a170 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:32.037510 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e08af2e2-3fb5-498f-838d-e404e344a170 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:32.038608 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e08af2e2-3fb5-498f-838d-e404e344a170 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:32.039263 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e08af2e2-3fb5-498f-838d-e404e344a170 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:32.039715 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e08af2e2-3fb5-498f-838d-e404e344a170 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:32.621686 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e08af2e2-3fb5-498f-838d-e404e344a170 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:32.639407 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e08af2e2-3fb5-498f-838d-e404e344a170 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:32.644210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e08af2e2-3fb5-498f-838d-e404e344a170 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:32.647567 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e08af2e2-3fb5-498f-838d-e404e344a170 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1722 microversion: 2.20 time: 0.641660 Aug 19 21:12:32.649303 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 232/432] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:32 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1722 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:12:33.676911 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-9910d433-f3aa-4a3f-84a5-de37c8b7cdc9 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:33.678817 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-9910d433-f3aa-4a3f-84a5-de37c8b7cdc9 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:33.691260 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9910d433-f3aa-4a3f-84a5-de37c8b7cdc9 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:33.692439 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9910d433-f3aa-4a3f-84a5-de37c8b7cdc9 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:33.693407 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9910d433-f3aa-4a3f-84a5-de37c8b7cdc9 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:33.694838 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9910d433-f3aa-4a3f-84a5-de37c8b7cdc9 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:33.695818 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9910d433-f3aa-4a3f-84a5-de37c8b7cdc9 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:33.696753 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9910d433-f3aa-4a3f-84a5-de37c8b7cdc9 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:33.906982 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9910d433-f3aa-4a3f-84a5-de37c8b7cdc9 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:33.920906 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9910d433-f3aa-4a3f-84a5-de37c8b7cdc9 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:33.922863 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9910d433-f3aa-4a3f-84a5-de37c8b7cdc9 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:33.924313 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-9910d433-f3aa-4a3f-84a5-de37c8b7cdc9 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1722 microversion: 2.20 time: 0.254827 Aug 19 21:12:33.938356 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 201/433] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:33 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:34.301980 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-53264a55-349f-41da-8389-8fecfdca7792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1468933401", "imageRef": "d1f034cf-f103-477b-bbb5-3298c678db05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b0fd483-0b8c-45b1-8b1c-2c76848b5463"}], "security_groups": [{"name": "tempest-securitygroup--1985450619"}], "key_name": "tempest-keypair-612838023", "user_data": "}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:12:34.424241 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.network.neutron [None req-53264a55-349f-41da-8389-8fecfdca7792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] validate_networks() for [('8b0fd483-0b8c-45b1-8b1c-2c76848b5463', None, None, None, None, None)] {{(pid=120877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 21:12:34.949358 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-48083516-a0eb-4d58-b128-c6ed00bea1f0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:34.950698 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-48083516-a0eb-4d58-b128-c6ed00bea1f0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:34.961742 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-48083516-a0eb-4d58-b128-c6ed00bea1f0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:34.962559 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-48083516-a0eb-4d58-b128-c6ed00bea1f0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:34.963177 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-48083516-a0eb-4d58-b128-c6ed00bea1f0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:34.964211 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-48083516-a0eb-4d58-b128-c6ed00bea1f0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:34.964841 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-48083516-a0eb-4d58-b128-c6ed00bea1f0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:34.965518 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-48083516-a0eb-4d58-b128-c6ed00bea1f0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:35.014362 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-53264a55-349f-41da-8389-8fecfdca7792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Flavor limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 21:12:35.015293 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-53264a55-349f-41da-8389-8fecfdca7792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Image limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 21:12:35.015865 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-53264a55-349f-41da-8389-8fecfdca7792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Flavor pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 21:12:35.016507 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-53264a55-349f-41da-8389-8fecfdca7792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Image pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 21:12:35.017341 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-53264a55-349f-41da-8389-8fecfdca7792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 21:12:35.028970 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-53264a55-349f-41da-8389-8fecfdca7792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:35.029875 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-53264a55-349f-41da-8389-8fecfdca7792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:35.030547 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-53264a55-349f-41da-8389-8fecfdca7792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:35.031861 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-53264a55-349f-41da-8389-8fecfdca7792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:35.032579 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-53264a55-349f-41da-8389-8fecfdca7792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:35.033211 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-53264a55-349f-41da-8389-8fecfdca7792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:35.070381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-53264a55-349f-41da-8389-8fecfdca7792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Getting quotas for project 358e50f9b9df43b7aa0a4ba1353e4a25. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:12:35.076829 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-53264a55-349f-41da-8389-8fecfdca7792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Getting quotas for user 7f46019e78cc4e89bf877a4f5a7a8fe9 and project 358e50f9b9df43b7aa0a4ba1353e4a25. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:12:35.101991 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-53264a55-349f-41da-8389-8fecfdca7792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Going to run 1 instances... {{(pid=120877) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 21:12:35.104859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-53264a55-349f-41da-8389-8fecfdca7792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f034cf-f103-477b-bbb5-3298c678db05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 21:12:35.186785 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-53264a55-349f-41da-8389-8fecfdca7792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.889432 Aug 19 21:12:35.190397 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-48083516-a0eb-4d58-b128-c6ed00bea1f0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:35.197029 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 233/434] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Aug 19 21:12:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 21:12:35.209135 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-48083516-a0eb-4d58-b128-c6ed00bea1f0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:35.211629 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-48083516-a0eb-4d58-b128-c6ed00bea1f0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:35.213572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0d74b5c6-22db-49ad-bd5f-65708a49186f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:35.215270 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0d74b5c6-22db-49ad-bd5f-65708a49186f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:35.218757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-48083516-a0eb-4d58-b128-c6ed00bea1f0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1722 microversion: 2.20 time: 0.273465 Aug 19 21:12:35.234569 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 202/435] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:34 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1722 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:35.311130 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0d74b5c6-22db-49ad-bd5f-65708a49186f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:35.324590 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0d74b5c6-22db-49ad-bd5f-65708a49186f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532" status: 200 len: 1241 microversion: 2.1 time: 0.122469 Aug 19 21:12:35.325898 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 234/436] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:35 2022] GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532 => generated 1241 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:36.246385 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-2b01d0e3-5870-41b6-91be-94b162ddc394 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:36.248389 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-2b01d0e3-5870-41b6-91be-94b162ddc394 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:36.264683 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2b01d0e3-5870-41b6-91be-94b162ddc394 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:36.266295 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2b01d0e3-5870-41b6-91be-94b162ddc394 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:36.267910 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2b01d0e3-5870-41b6-91be-94b162ddc394 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:36.271006 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2b01d0e3-5870-41b6-91be-94b162ddc394 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:36.272655 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2b01d0e3-5870-41b6-91be-94b162ddc394 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:36.274293 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2b01d0e3-5870-41b6-91be-94b162ddc394 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:36.361412 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-f9556a3d-ab6f-44ba-97e1-ac8f1bf69250 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:36.365034 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-f9556a3d-ab6f-44ba-97e1-ac8f1bf69250 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:36.378362 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f9556a3d-ab6f-44ba-97e1-ac8f1bf69250 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:36.381314 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f9556a3d-ab6f-44ba-97e1-ac8f1bf69250 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:36.384606 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f9556a3d-ab6f-44ba-97e1-ac8f1bf69250 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:36.385412 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f9556a3d-ab6f-44ba-97e1-ac8f1bf69250 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:36.385915 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f9556a3d-ab6f-44ba-97e1-ac8f1bf69250 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:36.386330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f9556a3d-ab6f-44ba-97e1-ac8f1bf69250 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:36.474969 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-2b01d0e3-5870-41b6-91be-94b162ddc394 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:36.493204 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-2b01d0e3-5870-41b6-91be-94b162ddc394 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:36.494775 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-2b01d0e3-5870-41b6-91be-94b162ddc394 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:36.495988 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-2b01d0e3-5870-41b6-91be-94b162ddc394 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1722 microversion: 2.20 time: 0.254554 Aug 19 21:12:36.496541 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 203/437] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:36 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:36.535976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-f9556a3d-ab6f-44ba-97e1-ac8f1bf69250 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:36.545616 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-f9556a3d-ab6f-44ba-97e1-ac8f1bf69250 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532" status: 200 len: 1293 microversion: 2.1 time: 0.193576 Aug 19 21:12:36.546241 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 235/438] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:36 2022] GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532 => generated 1293 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:37.522364 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-ab55c7c6-915d-4f6d-b6e2-a05e996819fe tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:37.524400 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-ab55c7c6-915d-4f6d-b6e2-a05e996819fe tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:37.534303 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ab55c7c6-915d-4f6d-b6e2-a05e996819fe tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:37.535702 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ab55c7c6-915d-4f6d-b6e2-a05e996819fe tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:37.536518 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ab55c7c6-915d-4f6d-b6e2-a05e996819fe tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:37.537892 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ab55c7c6-915d-4f6d-b6e2-a05e996819fe tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:37.538764 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ab55c7c6-915d-4f6d-b6e2-a05e996819fe tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:37.539409 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ab55c7c6-915d-4f6d-b6e2-a05e996819fe tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:37.572987 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:37.573924 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-eb97edaa-f0bc-4508-98ee-ed59b658fea2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:37.575970 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-eb97edaa-f0bc-4508-98ee-ed59b658fea2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:37.589427 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eb97edaa-f0bc-4508-98ee-ed59b658fea2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:37.590396 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eb97edaa-f0bc-4508-98ee-ed59b658fea2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:37.591539 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eb97edaa-f0bc-4508-98ee-ed59b658fea2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:37.592802 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eb97edaa-f0bc-4508-98ee-ed59b658fea2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:37.593642 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eb97edaa-f0bc-4508-98ee-ed59b658fea2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:37.594512 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eb97edaa-f0bc-4508-98ee-ed59b658fea2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:37.758193 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-eb97edaa-f0bc-4508-98ee-ed59b658fea2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:37.788833 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-eb97edaa-f0bc-4508-98ee-ed59b658fea2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532" status: 200 len: 1299 microversion: 2.1 time: 0.223424 Aug 19 21:12:37.790882 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 236/439] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:37 2022] GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532 => generated 1299 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:12:37.841726 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-ab55c7c6-915d-4f6d-b6e2-a05e996819fe tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:37.855757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-ab55c7c6-915d-4f6d-b6e2-a05e996819fe tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:37.858203 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-ab55c7c6-915d-4f6d-b6e2-a05e996819fe tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:37.859450 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-ab55c7c6-915d-4f6d-b6e2-a05e996819fe tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1743 microversion: 2.20 time: 0.343252 Aug 19 21:12:37.874126 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 204/440] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:37 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1743 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:38.834988 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-4d38437d-5f7f-46a5-9508-079424b7da1d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:38.836178 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-4d38437d-5f7f-46a5-9508-079424b7da1d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:38.850695 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4d38437d-5f7f-46a5-9508-079424b7da1d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:38.861261 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4d38437d-5f7f-46a5-9508-079424b7da1d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:38.862208 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4d38437d-5f7f-46a5-9508-079424b7da1d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:38.874112 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4d38437d-5f7f-46a5-9508-079424b7da1d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:38.874611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4d38437d-5f7f-46a5-9508-079424b7da1d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:38.875211 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4d38437d-5f7f-46a5-9508-079424b7da1d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:38.887476 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-a68f9b31-44ca-4213-b6e1-305d3c691723 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:38.888166 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-a68f9b31-44ca-4213-b6e1-305d3c691723 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:38.902920 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a68f9b31-44ca-4213-b6e1-305d3c691723 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:38.904022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a68f9b31-44ca-4213-b6e1-305d3c691723 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:38.905323 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a68f9b31-44ca-4213-b6e1-305d3c691723 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:38.906525 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a68f9b31-44ca-4213-b6e1-305d3c691723 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:38.907251 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a68f9b31-44ca-4213-b6e1-305d3c691723 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:38.908188 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a68f9b31-44ca-4213-b6e1-305d3c691723 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:39.340374 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-4d38437d-5f7f-46a5-9508-079424b7da1d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:39.349336 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-4d38437d-5f7f-46a5-9508-079424b7da1d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532" status: 200 len: 1367 microversion: 2.1 time: 0.521888 Aug 19 21:12:39.354918 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 237/441] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:38 2022] GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532 => generated 1367 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:12:39.422502 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-a68f9b31-44ca-4213-b6e1-305d3c691723 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:39.440768 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-a68f9b31-44ca-4213-b6e1-305d3c691723 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:39.443999 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-a68f9b31-44ca-4213-b6e1-305d3c691723 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:39.446385 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-a68f9b31-44ca-4213-b6e1-305d3c691723 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1743 microversion: 2.20 time: 0.564644 Aug 19 21:12:39.447464 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 205/442] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:38 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1743 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:39.637000 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-54ddd907-0848-4cad-8c0c-bd34bd3708d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:12:39.639663 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:39.645451 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-54ddd907-0848-4cad-8c0c-bd34bd3708d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:39.646333 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-54ddd907-0848-4cad-8c0c-bd34bd3708d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:39.646997 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-54ddd907-0848-4cad-8c0c-bd34bd3708d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:39.720948 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-54ddd907-0848-4cad-8c0c-bd34bd3708d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Going to try to stop instance {{(pid=120877) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 19 21:12:39.745339 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:39.792382 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-54ddd907-0848-4cad-8c0c-bd34bd3708d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "POST /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e/action" status: 202 len: 0 microversion: 2.1 time: 0.159305 Aug 19 21:12:39.794337 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 238/443] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Aug 19 21:12:39 2022] POST /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:12:39.804319 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-2123ad5e-6c54-487f-a6d6-2a7085a4a3b2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:39.804944 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-2123ad5e-6c54-487f-a6d6-2a7085a4a3b2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:39.815896 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2123ad5e-6c54-487f-a6d6-2a7085a4a3b2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:39.818589 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2123ad5e-6c54-487f-a6d6-2a7085a4a3b2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:39.819369 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2123ad5e-6c54-487f-a6d6-2a7085a4a3b2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:39.820255 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2123ad5e-6c54-487f-a6d6-2a7085a4a3b2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:39.820725 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2123ad5e-6c54-487f-a6d6-2a7085a4a3b2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:39.822329 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2123ad5e-6c54-487f-a6d6-2a7085a4a3b2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:39.901157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-5e74ad99-f616-4008-b56d-35682ad24426 req-f638d90a-2e39-4271-b1f8-0dcc77ea1a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee12fef4-cda2-4500-9975-002853bd4532", "tag": "1f2e766b-4dc3-43cb-ad33-5a377682a81e"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:12:39.938065 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-5e74ad99-f616-4008-b56d-35682ad24426 req-f638d90a-2e39-4271-b1f8-0dcc77ea1a5e service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:39.938706 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-5e74ad99-f616-4008-b56d-35682ad24426 req-f638d90a-2e39-4271-b1f8-0dcc77ea1a5e service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:39.939300 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-5e74ad99-f616-4008-b56d-35682ad24426 req-f638d90a-2e39-4271-b1f8-0dcc77ea1a5e service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:39.960696 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-5e74ad99-f616-4008-b56d-35682ad24426 req-f638d90a-2e39-4271-b1f8-0dcc77ea1a5e service nova] Creating event network-changed:1f2e766b-4dc3-43cb-ad33-5a377682a81e for instance ee12fef4-cda2-4500-9975-002853bd4532 on hv-cinder-85220 Aug 19 21:12:39.966164 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-5e74ad99-f616-4008-b56d-35682ad24426 req-f638d90a-2e39-4271-b1f8-0dcc77ea1a5e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074042 Aug 19 21:12:39.966911 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 239/444] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:12:40.039136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-2123ad5e-6c54-487f-a6d6-2a7085a4a3b2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:40.048796 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-2123ad5e-6c54-487f-a6d6-2a7085a4a3b2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1724 microversion: 2.1 time: 0.249741 Aug 19 21:12:40.062878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 206/445] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:39 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:40.380404 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-92d7fa65-7dfe-4456-adbc-23ece39870ea tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:40.381228 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-92d7fa65-7dfe-4456-adbc-23ece39870ea tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:40.392698 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-92d7fa65-7dfe-4456-adbc-23ece39870ea tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:40.393189 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-92d7fa65-7dfe-4456-adbc-23ece39870ea tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:40.396352 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-92d7fa65-7dfe-4456-adbc-23ece39870ea tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:40.397194 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-92d7fa65-7dfe-4456-adbc-23ece39870ea tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:40.397672 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-92d7fa65-7dfe-4456-adbc-23ece39870ea tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:40.399066 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-92d7fa65-7dfe-4456-adbc-23ece39870ea tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:40.469790 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-752bdeb2-b211-49a2-a2f9-a4019a305d86 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:40.470434 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-752bdeb2-b211-49a2-a2f9-a4019a305d86 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:40.480660 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-752bdeb2-b211-49a2-a2f9-a4019a305d86 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:40.481920 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-752bdeb2-b211-49a2-a2f9-a4019a305d86 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:40.482674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-752bdeb2-b211-49a2-a2f9-a4019a305d86 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:40.483837 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-752bdeb2-b211-49a2-a2f9-a4019a305d86 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:40.484586 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-752bdeb2-b211-49a2-a2f9-a4019a305d86 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:40.485312 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-752bdeb2-b211-49a2-a2f9-a4019a305d86 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:40.736794 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-92d7fa65-7dfe-4456-adbc-23ece39870ea tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:40.748168 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-92d7fa65-7dfe-4456-adbc-23ece39870ea tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532" status: 200 len: 1367 microversion: 2.1 time: 0.372732 Aug 19 21:12:40.762855 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 240/446] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:40 2022] GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532 => generated 1367 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:40.783779 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-752bdeb2-b211-49a2-a2f9-a4019a305d86 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:40.804745 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-752bdeb2-b211-49a2-a2f9-a4019a305d86 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:40.807271 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-752bdeb2-b211-49a2-a2f9-a4019a305d86 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:40.811233 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-752bdeb2-b211-49a2-a2f9-a4019a305d86 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1743 microversion: 2.20 time: 0.344611 Aug 19 21:12:40.813065 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 207/447] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:40 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1743 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:41.078119 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0c29dc5d-efb6-4a3a-95c0-51930dfcea59 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:41.079661 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0c29dc5d-efb6-4a3a-95c0-51930dfcea59 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:41.096840 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0c29dc5d-efb6-4a3a-95c0-51930dfcea59 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:41.097952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0c29dc5d-efb6-4a3a-95c0-51930dfcea59 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:41.098715 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0c29dc5d-efb6-4a3a-95c0-51930dfcea59 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:41.099759 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0c29dc5d-efb6-4a3a-95c0-51930dfcea59 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:41.100528 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0c29dc5d-efb6-4a3a-95c0-51930dfcea59 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:41.100966 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0c29dc5d-efb6-4a3a-95c0-51930dfcea59 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:41.308219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0c29dc5d-efb6-4a3a-95c0-51930dfcea59 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:41.325217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0c29dc5d-efb6-4a3a-95c0-51930dfcea59 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1724 microversion: 2.1 time: 0.250733 Aug 19 21:12:41.326652 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 241/448] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:41 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:41.775549 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-f102c879-4121-43d1-b67b-01dcad9c4081 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:41.776253 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-f102c879-4121-43d1-b67b-01dcad9c4081 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:41.785285 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f102c879-4121-43d1-b67b-01dcad9c4081 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:41.786394 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f102c879-4121-43d1-b67b-01dcad9c4081 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:41.787161 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f102c879-4121-43d1-b67b-01dcad9c4081 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:41.788256 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f102c879-4121-43d1-b67b-01dcad9c4081 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:41.788858 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f102c879-4121-43d1-b67b-01dcad9c4081 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:41.789417 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f102c879-4121-43d1-b67b-01dcad9c4081 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:41.845312 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ea9b41ac-da88-477a-8ffc-71f627af73ea tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:41.846523 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ea9b41ac-da88-477a-8ffc-71f627af73ea tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:41.857070 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea9b41ac-da88-477a-8ffc-71f627af73ea tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:41.857678 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea9b41ac-da88-477a-8ffc-71f627af73ea tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:41.858025 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea9b41ac-da88-477a-8ffc-71f627af73ea tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:41.858735 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea9b41ac-da88-477a-8ffc-71f627af73ea tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:41.859191 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea9b41ac-da88-477a-8ffc-71f627af73ea tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:41.859611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea9b41ac-da88-477a-8ffc-71f627af73ea tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:41.903456 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=4 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:42.029021 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-f102c879-4121-43d1-b67b-01dcad9c4081 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:42.045529 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-f102c879-4121-43d1-b67b-01dcad9c4081 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532" status: 200 len: 1367 microversion: 2.1 time: 0.273336 Aug 19 21:12:42.057791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 208/449] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:41 2022] GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532 => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:42.101891 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ea9b41ac-da88-477a-8ffc-71f627af73ea tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:42.112386 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ea9b41ac-da88-477a-8ffc-71f627af73ea tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:42.114667 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ea9b41ac-da88-477a-8ffc-71f627af73ea tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:42.115908 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ea9b41ac-da88-477a-8ffc-71f627af73ea tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1743 microversion: 2.20 time: 0.276424 Aug 19 21:12:42.129791 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 242/450] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:41 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1743 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:42.339516 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-8e8f5c7e-6242-4a28-833a-45c905ffddd8 req-1bd69510-d26a-4beb-9e80-6218f8325f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95c060a-e4cc-436c-a185-9345fd2c44f2", "name": "network-vif-plugged", "status": "completed", "tag": "c65527c3-278b-404c-9369-abd76c37a0b5"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:12:42.353473 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-8e8f5c7e-6242-4a28-833a-45c905ffddd8 req-1bd69510-d26a-4beb-9e80-6218f8325f39 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:42.354059 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-8e8f5c7e-6242-4a28-833a-45c905ffddd8 req-1bd69510-d26a-4beb-9e80-6218f8325f39 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:42.354494 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-8e8f5c7e-6242-4a28-833a-45c905ffddd8 req-1bd69510-d26a-4beb-9e80-6218f8325f39 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:42.367703 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-bbb8746f-9b81-4db3-b5ed-d625b5eebcba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:42.368667 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-bbb8746f-9b81-4db3-b5ed-d625b5eebcba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:42.369455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-8e8f5c7e-6242-4a28-833a-45c905ffddd8 req-1bd69510-d26a-4beb-9e80-6218f8325f39 service nova] Creating event network-vif-plugged:c65527c3-278b-404c-9369-abd76c37a0b5 for instance f95c060a-e4cc-436c-a185-9345fd2c44f2 on hv-cinder-85220 Aug 19 21:12:42.376977 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-8e8f5c7e-6242-4a28-833a-45c905ffddd8 req-1bd69510-d26a-4beb-9e80-6218f8325f39 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042990 Aug 19 21:12:42.377589 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 209/451] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:12:42.382708 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bbb8746f-9b81-4db3-b5ed-d625b5eebcba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:42.383748 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bbb8746f-9b81-4db3-b5ed-d625b5eebcba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:42.384581 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bbb8746f-9b81-4db3-b5ed-d625b5eebcba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:42.385638 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bbb8746f-9b81-4db3-b5ed-d625b5eebcba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:42.386329 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bbb8746f-9b81-4db3-b5ed-d625b5eebcba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:42.386993 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bbb8746f-9b81-4db3-b5ed-d625b5eebcba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:42.558155 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-bbb8746f-9b81-4db3-b5ed-d625b5eebcba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:42.568332 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-bbb8746f-9b81-4db3-b5ed-d625b5eebcba tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1724 microversion: 2.1 time: 0.206859 Aug 19 21:12:42.582645 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 243/452] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:42 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:43.076343 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-ebfa9d9f-dbb4-4a6f-a04b-9bc688a8328d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:43.077266 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-ebfa9d9f-dbb4-4a6f-a04b-9bc688a8328d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:43.091596 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ebfa9d9f-dbb4-4a6f-a04b-9bc688a8328d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:43.092098 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ebfa9d9f-dbb4-4a6f-a04b-9bc688a8328d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:43.092534 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ebfa9d9f-dbb4-4a6f-a04b-9bc688a8328d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:43.093249 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ebfa9d9f-dbb4-4a6f-a04b-9bc688a8328d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:43.093709 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ebfa9d9f-dbb4-4a6f-a04b-9bc688a8328d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:43.094168 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ebfa9d9f-dbb4-4a6f-a04b-9bc688a8328d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:43.141056 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-1b6b0219-6ae0-4ff7-97a6-6ebe49c32622 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:43.142259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-1b6b0219-6ae0-4ff7-97a6-6ebe49c32622 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:43.151395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1b6b0219-6ae0-4ff7-97a6-6ebe49c32622 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:43.152469 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1b6b0219-6ae0-4ff7-97a6-6ebe49c32622 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:43.153081 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1b6b0219-6ae0-4ff7-97a6-6ebe49c32622 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:43.154237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1b6b0219-6ae0-4ff7-97a6-6ebe49c32622 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:43.154904 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1b6b0219-6ae0-4ff7-97a6-6ebe49c32622 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:43.155508 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1b6b0219-6ae0-4ff7-97a6-6ebe49c32622 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:43.306457 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-ebfa9d9f-dbb4-4a6f-a04b-9bc688a8328d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:43.324615 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-ebfa9d9f-dbb4-4a6f-a04b-9bc688a8328d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532" status: 200 len: 1367 microversion: 2.1 time: 0.253383 Aug 19 21:12:43.342041 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 210/453] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:43 2022] GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532 => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:12:43.384606 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-1b6b0219-6ae0-4ff7-97a6-6ebe49c32622 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:43.394049 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-1b6b0219-6ae0-4ff7-97a6-6ebe49c32622 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:43.396936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-1b6b0219-6ae0-4ff7-97a6-6ebe49c32622 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:43.398204 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-1b6b0219-6ae0-4ff7-97a6-6ebe49c32622 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1743 microversion: 2.20 time: 0.261644 Aug 19 21:12:43.414092 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 244/454] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:43 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1743 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:43.592145 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-fa639183-6cbb-40a0-be30-767e4dc37327 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:43.592580 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-fa639183-6cbb-40a0-be30-767e4dc37327 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:43.601174 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fa639183-6cbb-40a0-be30-767e4dc37327 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:43.601683 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fa639183-6cbb-40a0-be30-767e4dc37327 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:43.602157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fa639183-6cbb-40a0-be30-767e4dc37327 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:43.602872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fa639183-6cbb-40a0-be30-767e4dc37327 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:43.603707 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fa639183-6cbb-40a0-be30-767e4dc37327 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:43.604149 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fa639183-6cbb-40a0-be30-767e4dc37327 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:43.763312 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-fa639183-6cbb-40a0-be30-767e4dc37327 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:43.783228 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-fa639183-6cbb-40a0-be30-767e4dc37327 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1724 microversion: 2.1 time: 0.194277 Aug 19 21:12:43.784593 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 211/455] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:43 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:12:44.364757 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3d481774-9e05-44ea-b84c-9503a7b5c7a2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:44.365524 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-3d481774-9e05-44ea-b84c-9503a7b5c7a2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:44.375576 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3d481774-9e05-44ea-b84c-9503a7b5c7a2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:44.376267 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3d481774-9e05-44ea-b84c-9503a7b5c7a2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:44.377093 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3d481774-9e05-44ea-b84c-9503a7b5c7a2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:44.378462 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3d481774-9e05-44ea-b84c-9503a7b5c7a2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:44.379569 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3d481774-9e05-44ea-b84c-9503a7b5c7a2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:44.380872 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3d481774-9e05-44ea-b84c-9503a7b5c7a2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:44.422325 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-6d18d0b8-c855-43ec-a059-305a34c0a4c8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:44.423664 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-6d18d0b8-c855-43ec-a059-305a34c0a4c8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:44.431107 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6d18d0b8-c855-43ec-a059-305a34c0a4c8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:44.431598 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6d18d0b8-c855-43ec-a059-305a34c0a4c8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:44.432030 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6d18d0b8-c855-43ec-a059-305a34c0a4c8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:44.432729 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6d18d0b8-c855-43ec-a059-305a34c0a4c8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:44.433173 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6d18d0b8-c855-43ec-a059-305a34c0a4c8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:44.433583 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6d18d0b8-c855-43ec-a059-305a34c0a4c8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:44.608245 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3d481774-9e05-44ea-b84c-9503a7b5c7a2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:44.623553 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-3d481774-9e05-44ea-b84c-9503a7b5c7a2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532" status: 200 len: 1367 microversion: 2.1 time: 0.266764 Aug 19 21:12:44.635589 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 245/456] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:44 2022] GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532 => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:44.657636 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-6d18d0b8-c855-43ec-a059-305a34c0a4c8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:44.672881 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-6d18d0b8-c855-43ec-a059-305a34c0a4c8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:44.674449 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-6d18d0b8-c855-43ec-a059-305a34c0a4c8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:44.678373 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-6d18d0b8-c855-43ec-a059-305a34c0a4c8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1743 microversion: 2.20 time: 0.259567 Aug 19 21:12:44.679686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 212/457] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:44 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1743 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:44.821393 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-5dda480b-dfbc-42c0-9373-58b858696df3 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:44.822103 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-5dda480b-dfbc-42c0-9373-58b858696df3 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:44.834575 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5dda480b-dfbc-42c0-9373-58b858696df3 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:44.835850 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5dda480b-dfbc-42c0-9373-58b858696df3 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:44.836941 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5dda480b-dfbc-42c0-9373-58b858696df3 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:44.838624 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5dda480b-dfbc-42c0-9373-58b858696df3 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:44.839857 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5dda480b-dfbc-42c0-9373-58b858696df3 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:44.840904 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5dda480b-dfbc-42c0-9373-58b858696df3 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:45.047189 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=2 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:45.085192 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-5dda480b-dfbc-42c0-9373-58b858696df3 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:45.101344 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-5dda480b-dfbc-42c0-9373-58b858696df3 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1724 microversion: 2.1 time: 0.287332 Aug 19 21:12:45.102251 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 246/458] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:44 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1724 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:45.660259 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-55f47bfb-9d32-45a4-96b6-0331baebe422 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:45.662183 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-55f47bfb-9d32-45a4-96b6-0331baebe422 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:45.687673 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-55f47bfb-9d32-45a4-96b6-0331baebe422 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:45.688779 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-55f47bfb-9d32-45a4-96b6-0331baebe422 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:45.690212 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-55f47bfb-9d32-45a4-96b6-0331baebe422 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:45.692319 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-55f47bfb-9d32-45a4-96b6-0331baebe422 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:45.693447 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-55f47bfb-9d32-45a4-96b6-0331baebe422 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:45.694870 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-55f47bfb-9d32-45a4-96b6-0331baebe422 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:45.730680 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3f78b15a-2dff-4412-9e66-986d9ba332ba tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:45.735627 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-3f78b15a-2dff-4412-9e66-986d9ba332ba tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:45.752874 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=8 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:45.756634 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3f78b15a-2dff-4412-9e66-986d9ba332ba tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:45.758828 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3f78b15a-2dff-4412-9e66-986d9ba332ba tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:45.759743 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3f78b15a-2dff-4412-9e66-986d9ba332ba tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:45.760944 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3f78b15a-2dff-4412-9e66-986d9ba332ba tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:45.761863 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3f78b15a-2dff-4412-9e66-986d9ba332ba tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:45.762364 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3f78b15a-2dff-4412-9e66-986d9ba332ba tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:46.111695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-55f47bfb-9d32-45a4-96b6-0331baebe422 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:46.122916 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3f78b15a-2dff-4412-9e66-986d9ba332ba tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:46.131353 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-55f47bfb-9d32-45a4-96b6-0331baebe422 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532" status: 200 len: 1367 microversion: 2.1 time: 0.475158 Aug 19 21:12:46.145828 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 213/459] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:45 2022] GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532 => generated 1367 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:46.145828 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-01ef6637-0d6f-484d-a3c5-d631fd95abd5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:46.146483 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-01ef6637-0d6f-484d-a3c5-d631fd95abd5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:46.169310 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-01ef6637-0d6f-484d-a3c5-d631fd95abd5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:46.169584 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3f78b15a-2dff-4412-9e66-986d9ba332ba tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:46.169842 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-01ef6637-0d6f-484d-a3c5-d631fd95abd5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:46.170291 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-01ef6637-0d6f-484d-a3c5-d631fd95abd5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:46.171049 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-01ef6637-0d6f-484d-a3c5-d631fd95abd5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:46.171515 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-01ef6637-0d6f-484d-a3c5-d631fd95abd5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:46.171946 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-01ef6637-0d6f-484d-a3c5-d631fd95abd5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:46.175453 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3f78b15a-2dff-4412-9e66-986d9ba332ba tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:46.183572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-3f78b15a-2dff-4412-9e66-986d9ba332ba tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1743 microversion: 2.20 time: 0.472069 Aug 19 21:12:46.196171 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 247/460] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:45 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1743 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:46.619258 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-01ef6637-0d6f-484d-a3c5-d631fd95abd5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:46.629058 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-01ef6637-0d6f-484d-a3c5-d631fd95abd5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1724 microversion: 2.1 time: 0.495133 Aug 19 21:12:46.630180 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 214/461] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:46 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1724 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:47.168106 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-fd24000d-ab10-4794-8bee-9d2ab70c4e7c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:47.171125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-fd24000d-ab10-4794-8bee-9d2ab70c4e7c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:47.186885 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fd24000d-ab10-4794-8bee-9d2ab70c4e7c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:47.187973 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fd24000d-ab10-4794-8bee-9d2ab70c4e7c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:47.188899 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fd24000d-ab10-4794-8bee-9d2ab70c4e7c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:47.190599 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fd24000d-ab10-4794-8bee-9d2ab70c4e7c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:47.191670 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fd24000d-ab10-4794-8bee-9d2ab70c4e7c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:47.192792 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fd24000d-ab10-4794-8bee-9d2ab70c4e7c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:47.228262 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-c4fc883e-3188-4ee8-83ed-59dca34be954 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:47.229018 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-c4fc883e-3188-4ee8-83ed-59dca34be954 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:47.253275 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c4fc883e-3188-4ee8-83ed-59dca34be954 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:47.254297 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c4fc883e-3188-4ee8-83ed-59dca34be954 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:47.256053 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c4fc883e-3188-4ee8-83ed-59dca34be954 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:47.260145 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c4fc883e-3188-4ee8-83ed-59dca34be954 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:47.260644 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c4fc883e-3188-4ee8-83ed-59dca34be954 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:47.261085 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c4fc883e-3188-4ee8-83ed-59dca34be954 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:47.481813 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-fd24000d-ab10-4794-8bee-9d2ab70c4e7c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:47.494504 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-fd24000d-ab10-4794-8bee-9d2ab70c4e7c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532" status: 200 len: 1367 microversion: 2.1 time: 0.335823 Aug 19 21:12:47.495368 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 248/462] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:47 2022] GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532 => generated 1367 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:47.581510 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-c4fc883e-3188-4ee8-83ed-59dca34be954 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:47.600782 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-c4fc883e-3188-4ee8-83ed-59dca34be954 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:47.606023 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-c4fc883e-3188-4ee8-83ed-59dca34be954 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:47.607556 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-c4fc883e-3188-4ee8-83ed-59dca34be954 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1738 microversion: 2.20 time: 0.390110 Aug 19 21:12:47.628076 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 215/463] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:47 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1738 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:12:47.671347 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-f38943bc-634a-4ac9-854d-7135e529dc7c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:47.676600 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-f38943bc-634a-4ac9-854d-7135e529dc7c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:47.684251 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f38943bc-634a-4ac9-854d-7135e529dc7c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:47.685176 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f38943bc-634a-4ac9-854d-7135e529dc7c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:47.685936 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f38943bc-634a-4ac9-854d-7135e529dc7c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:47.687109 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f38943bc-634a-4ac9-854d-7135e529dc7c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:47.687810 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f38943bc-634a-4ac9-854d-7135e529dc7c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:47.688457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f38943bc-634a-4ac9-854d-7135e529dc7c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:48.049728 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-f38943bc-634a-4ac9-854d-7135e529dc7c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:48.079396 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-f38943bc-634a-4ac9-854d-7135e529dc7c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1724 microversion: 2.1 time: 0.411628 Aug 19 21:12:48.080378 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 249/464] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:47 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1724 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:48.526884 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-e4f0597b-21d5-4be1-87d4-010e34d540f8 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:48.527719 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-e4f0597b-21d5-4be1-87d4-010e34d540f8 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:48.543357 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e4f0597b-21d5-4be1-87d4-010e34d540f8 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:48.545083 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e4f0597b-21d5-4be1-87d4-010e34d540f8 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:48.546246 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e4f0597b-21d5-4be1-87d4-010e34d540f8 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:48.549436 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e4f0597b-21d5-4be1-87d4-010e34d540f8 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:48.550389 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e4f0597b-21d5-4be1-87d4-010e34d540f8 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:48.551068 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e4f0597b-21d5-4be1-87d4-010e34d540f8 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:48.637584 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0aced16a-667e-4783-a847-d04347c6bc07 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:48.638435 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0aced16a-667e-4783-a847-d04347c6bc07 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:48.654888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0aced16a-667e-4783-a847-d04347c6bc07 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:48.655643 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0aced16a-667e-4783-a847-d04347c6bc07 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:48.656751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0aced16a-667e-4783-a847-d04347c6bc07 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:48.657657 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0aced16a-667e-4783-a847-d04347c6bc07 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:48.658797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0aced16a-667e-4783-a847-d04347c6bc07 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:48.661416 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0aced16a-667e-4783-a847-d04347c6bc07 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:48.861318 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-e4f0597b-21d5-4be1-87d4-010e34d540f8 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:48.887469 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-e4f0597b-21d5-4be1-87d4-010e34d540f8 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532" status: 200 len: 1367 microversion: 2.1 time: 0.362850 Aug 19 21:12:48.902365 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 216/465] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:48 2022] GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532 => generated 1367 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:48.914206 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-71ac1c1d-195a-4be6-bfa1-d73614e92c43 req-56e684b7-176e-437a-ab17-bdcfa8ceec74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee12fef4-cda2-4500-9975-002853bd4532", "name": "network-vif-plugged", "status": "completed", "tag": "1f2e766b-4dc3-43cb-ad33-5a377682a81e"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:12:48.927150 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0aced16a-667e-4783-a847-d04347c6bc07 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:48.936247 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-71ac1c1d-195a-4be6-bfa1-d73614e92c43 req-56e684b7-176e-437a-ab17-bdcfa8ceec74 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:48.937707 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-71ac1c1d-195a-4be6-bfa1-d73614e92c43 req-56e684b7-176e-437a-ab17-bdcfa8ceec74 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:48.939255 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-71ac1c1d-195a-4be6-bfa1-d73614e92c43 req-56e684b7-176e-437a-ab17-bdcfa8ceec74 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:48.939462 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0aced16a-667e-4783-a847-d04347c6bc07 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:48.942589 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0aced16a-667e-4783-a847-d04347c6bc07 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:48.943826 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0aced16a-667e-4783-a847-d04347c6bc07 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1738 microversion: 2.20 time: 0.310819 Aug 19 21:12:48.966029 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 250/466] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:48 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1738 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:12:48.974141 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-71ac1c1d-195a-4be6-bfa1-d73614e92c43 req-56e684b7-176e-437a-ab17-bdcfa8ceec74 service nova] Creating event network-vif-plugged:1f2e766b-4dc3-43cb-ad33-5a377682a81e for instance ee12fef4-cda2-4500-9975-002853bd4532 on hv-cinder-85220 Aug 19 21:12:48.985399 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-71ac1c1d-195a-4be6-bfa1-d73614e92c43 req-56e684b7-176e-437a-ab17-bdcfa8ceec74 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080069 Aug 19 21:12:48.987553 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 217/467] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:12:49.105715 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-d2736057-5d88-4a9f-a7d5-1d81b4e46dc0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:49.108509 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-d2736057-5d88-4a9f-a7d5-1d81b4e46dc0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:49.119494 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d2736057-5d88-4a9f-a7d5-1d81b4e46dc0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:49.120802 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d2736057-5d88-4a9f-a7d5-1d81b4e46dc0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:49.123401 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d2736057-5d88-4a9f-a7d5-1d81b4e46dc0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:49.125383 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d2736057-5d88-4a9f-a7d5-1d81b4e46dc0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:49.127889 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d2736057-5d88-4a9f-a7d5-1d81b4e46dc0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:49.130093 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d2736057-5d88-4a9f-a7d5-1d81b4e46dc0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:49.409464 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-d2736057-5d88-4a9f-a7d5-1d81b4e46dc0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:49.419754 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-d2736057-5d88-4a9f-a7d5-1d81b4e46dc0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1724 microversion: 2.1 time: 0.320011 Aug 19 21:12:49.421232 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 251/468] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:49 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1724 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:49.926643 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-a58ae57c-0f3e-4fb0-a294-6c7bc91cba9d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:49.928202 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-a58ae57c-0f3e-4fb0-a294-6c7bc91cba9d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:49.937710 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a58ae57c-0f3e-4fb0-a294-6c7bc91cba9d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:49.938538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a58ae57c-0f3e-4fb0-a294-6c7bc91cba9d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:49.939356 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a58ae57c-0f3e-4fb0-a294-6c7bc91cba9d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:49.940133 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a58ae57c-0f3e-4fb0-a294-6c7bc91cba9d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:49.940658 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a58ae57c-0f3e-4fb0-a294-6c7bc91cba9d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:49.941962 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a58ae57c-0f3e-4fb0-a294-6c7bc91cba9d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:49.974524 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-b58a5f81-abc3-4fa6-b6b5-0a627a6a779a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:49.975845 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-b58a5f81-abc3-4fa6-b6b5-0a627a6a779a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:49.983414 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b58a5f81-abc3-4fa6-b6b5-0a627a6a779a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:49.984247 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b58a5f81-abc3-4fa6-b6b5-0a627a6a779a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:49.985049 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b58a5f81-abc3-4fa6-b6b5-0a627a6a779a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:49.986627 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b58a5f81-abc3-4fa6-b6b5-0a627a6a779a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:49.990574 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b58a5f81-abc3-4fa6-b6b5-0a627a6a779a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:49.991642 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b58a5f81-abc3-4fa6-b6b5-0a627a6a779a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:50.198592 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-a58ae57c-0f3e-4fb0-a294-6c7bc91cba9d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:50.211903 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-a58ae57c-0f3e-4fb0-a294-6c7bc91cba9d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532" status: 200 len: 1367 microversion: 2.1 time: 0.291169 Aug 19 21:12:50.226832 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 218/469] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:49 2022] GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532 => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:12:50.229182 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-b58a5f81-abc3-4fa6-b6b5-0a627a6a779a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:50.240009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-b58a5f81-abc3-4fa6-b6b5-0a627a6a779a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:50.241681 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-b58a5f81-abc3-4fa6-b6b5-0a627a6a779a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:50.242976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-b58a5f81-abc3-4fa6-b6b5-0a627a6a779a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1738 microversion: 2.20 time: 0.273712 Aug 19 21:12:50.243610 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 252/470] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:49 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1738 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:50.444540 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-161f04a3-628a-4fd1-ad36-1456d4b48ee3 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:50.445159 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-161f04a3-628a-4fd1-ad36-1456d4b48ee3 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:50.451588 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-161f04a3-628a-4fd1-ad36-1456d4b48ee3 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:50.452080 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-161f04a3-628a-4fd1-ad36-1456d4b48ee3 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:50.452516 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-161f04a3-628a-4fd1-ad36-1456d4b48ee3 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:50.453214 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-161f04a3-628a-4fd1-ad36-1456d4b48ee3 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:50.453671 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-161f04a3-628a-4fd1-ad36-1456d4b48ee3 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:50.454126 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-161f04a3-628a-4fd1-ad36-1456d4b48ee3 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:50.632200 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-161f04a3-628a-4fd1-ad36-1456d4b48ee3 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:50.647887 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-161f04a3-628a-4fd1-ad36-1456d4b48ee3 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1724 microversion: 2.1 time: 0.207298 Aug 19 21:12:50.666251 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 219/471] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:50 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:51.234175 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-9619aa70-7b37-4b7e-b1a4-c5e34ec46174 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:51.234900 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-9619aa70-7b37-4b7e-b1a4-c5e34ec46174 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:51.243473 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9619aa70-7b37-4b7e-b1a4-c5e34ec46174 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:51.243985 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9619aa70-7b37-4b7e-b1a4-c5e34ec46174 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:51.251706 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9619aa70-7b37-4b7e-b1a4-c5e34ec46174 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:51.251706 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9619aa70-7b37-4b7e-b1a4-c5e34ec46174 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:51.251706 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9619aa70-7b37-4b7e-b1a4-c5e34ec46174 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:51.251706 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9619aa70-7b37-4b7e-b1a4-c5e34ec46174 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:51.267269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-f946ee7c-8efc-401f-b6c6-4501f4a8eb13 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:51.268186 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-f946ee7c-8efc-401f-b6c6-4501f4a8eb13 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:51.286317 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f946ee7c-8efc-401f-b6c6-4501f4a8eb13 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:51.286906 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f946ee7c-8efc-401f-b6c6-4501f4a8eb13 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:51.287569 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f946ee7c-8efc-401f-b6c6-4501f4a8eb13 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:51.291012 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f946ee7c-8efc-401f-b6c6-4501f4a8eb13 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:51.291819 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f946ee7c-8efc-401f-b6c6-4501f4a8eb13 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:51.292469 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f946ee7c-8efc-401f-b6c6-4501f4a8eb13 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:51.537671 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-9619aa70-7b37-4b7e-b1a4-c5e34ec46174 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:51.543335 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-f946ee7c-8efc-401f-b6c6-4501f4a8eb13 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:51.551564 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-9619aa70-7b37-4b7e-b1a4-c5e34ec46174 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532" status: 200 len: 1557 microversion: 2.1 time: 0.320806 Aug 19 21:12:51.566459 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 253/472] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:51 2022] GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532 => generated 1557 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:12:51.570455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-f946ee7c-8efc-401f-b6c6-4501f4a8eb13 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:51.575808 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-f946ee7c-8efc-401f-b6c6-4501f4a8eb13 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:51.577263 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-f946ee7c-8efc-401f-b6c6-4501f4a8eb13 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1738 microversion: 2.20 time: 0.314183 Aug 19 21:12:51.578543 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 220/473] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:51 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1738 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:51.585806 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-5f94019b-61a5-4b92-86d2-b221bb6d7f47 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:51.586409 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-5f94019b-61a5-4b92-86d2-b221bb6d7f47 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:51.602978 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5f94019b-61a5-4b92-86d2-b221bb6d7f47 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:51.603792 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5f94019b-61a5-4b92-86d2-b221bb6d7f47 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:51.604375 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5f94019b-61a5-4b92-86d2-b221bb6d7f47 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:51.605598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5f94019b-61a5-4b92-86d2-b221bb6d7f47 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:51.606213 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5f94019b-61a5-4b92-86d2-b221bb6d7f47 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:51.606650 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5f94019b-61a5-4b92-86d2-b221bb6d7f47 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:51.697390 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-064bfd67-2f2e-48aa-b3dd-33609854a17c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:51.698073 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-064bfd67-2f2e-48aa-b3dd-33609854a17c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:51.705497 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-064bfd67-2f2e-48aa-b3dd-33609854a17c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:51.706027 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-064bfd67-2f2e-48aa-b3dd-33609854a17c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:51.707111 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-064bfd67-2f2e-48aa-b3dd-33609854a17c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:51.708013 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-064bfd67-2f2e-48aa-b3dd-33609854a17c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:51.708489 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-064bfd67-2f2e-48aa-b3dd-33609854a17c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:51.708913 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-064bfd67-2f2e-48aa-b3dd-33609854a17c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:51.723607 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-5f94019b-61a5-4b92-86d2-b221bb6d7f47 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.144422 Aug 19 21:12:51.724207 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 254/474] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Aug 19 21:12:51 2022] GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:12:52.084813 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-064bfd67-2f2e-48aa-b3dd-33609854a17c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:52.094494 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-064bfd67-2f2e-48aa-b3dd-33609854a17c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1724 microversion: 2.1 time: 0.420255 Aug 19 21:12:52.095689 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 221/475] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:51 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1724 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:12:52.623045 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3e431bba-6c6c-4bba-8087-56dbb579f948 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:52.627207 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-3e431bba-6c6c-4bba-8087-56dbb579f948 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:52.658690 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3e431bba-6c6c-4bba-8087-56dbb579f948 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:52.662566 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3e431bba-6c6c-4bba-8087-56dbb579f948 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:52.664827 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3e431bba-6c6c-4bba-8087-56dbb579f948 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:52.666433 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3e431bba-6c6c-4bba-8087-56dbb579f948 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:52.668506 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3e431bba-6c6c-4bba-8087-56dbb579f948 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:52.669737 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3e431bba-6c6c-4bba-8087-56dbb579f948 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:53.036648 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3e431bba-6c6c-4bba-8087-56dbb579f948 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:53.040322 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:53.053557 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3e431bba-6c6c-4bba-8087-56dbb579f948 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:53.059804 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3e431bba-6c6c-4bba-8087-56dbb579f948 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:53.061332 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-3e431bba-6c6c-4bba-8087-56dbb579f948 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1738 microversion: 2.20 time: 0.464395 Aug 19 21:12:53.062451 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 255/476] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:52 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1738 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:53.119086 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-5ef62eb6-b882-494b-abf9-0ece4dbdd1d4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:53.119885 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-5ef62eb6-b882-494b-abf9-0ece4dbdd1d4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:53.122767 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:53.142312 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5ef62eb6-b882-494b-abf9-0ece4dbdd1d4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:53.142815 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5ef62eb6-b882-494b-abf9-0ece4dbdd1d4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:53.143242 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5ef62eb6-b882-494b-abf9-0ece4dbdd1d4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:53.145869 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5ef62eb6-b882-494b-abf9-0ece4dbdd1d4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:53.146964 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5ef62eb6-b882-494b-abf9-0ece4dbdd1d4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:53.147653 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5ef62eb6-b882-494b-abf9-0ece4dbdd1d4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:53.174333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=100 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:12:53.495142 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-5ef62eb6-b882-494b-abf9-0ece4dbdd1d4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:53.531857 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-5ef62eb6-b882-494b-abf9-0ece4dbdd1d4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1724 microversion: 2.1 time: 0.417211 Aug 19 21:12:53.537443 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 222/477] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:53 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1724 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:12:53.660708 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-e5bdf431-23a6-4b5e-8a03-e9dad29ab45a req-e787b9f3-b8dd-4bc0-9519-4243c1736c87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee12fef4-cda2-4500-9975-002853bd4532", "tag": "1f2e766b-4dc3-43cb-ad33-5a377682a81e"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:12:53.690063 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-e5bdf431-23a6-4b5e-8a03-e9dad29ab45a req-e787b9f3-b8dd-4bc0-9519-4243c1736c87 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:53.691102 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-e5bdf431-23a6-4b5e-8a03-e9dad29ab45a req-e787b9f3-b8dd-4bc0-9519-4243c1736c87 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:53.691806 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-e5bdf431-23a6-4b5e-8a03-e9dad29ab45a req-e787b9f3-b8dd-4bc0-9519-4243c1736c87 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:53.739098 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-e5bdf431-23a6-4b5e-8a03-e9dad29ab45a req-e787b9f3-b8dd-4bc0-9519-4243c1736c87 service nova] Creating event network-changed:1f2e766b-4dc3-43cb-ad33-5a377682a81e for instance ee12fef4-cda2-4500-9975-002853bd4532 on hv-cinder-85220 Aug 19 21:12:53.750614 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-e5bdf431-23a6-4b5e-8a03-e9dad29ab45a req-e787b9f3-b8dd-4bc0-9519-4243c1736c87 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094279 Aug 19 21:12:53.755050 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 256/478] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:12:54.101842 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-ed39d8c6-eab1-451b-a2b6-9ede8d2aa172 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:54.103324 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-ed39d8c6-eab1-451b-a2b6-9ede8d2aa172 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:54.131215 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ed39d8c6-eab1-451b-a2b6-9ede8d2aa172 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:54.141904 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ed39d8c6-eab1-451b-a2b6-9ede8d2aa172 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:54.143371 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ed39d8c6-eab1-451b-a2b6-9ede8d2aa172 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:54.151376 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ed39d8c6-eab1-451b-a2b6-9ede8d2aa172 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:54.152182 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ed39d8c6-eab1-451b-a2b6-9ede8d2aa172 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:54.157956 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ed39d8c6-eab1-451b-a2b6-9ede8d2aa172 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:54.559967 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-ed39d8c6-eab1-451b-a2b6-9ede8d2aa172 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:54.566871 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-eabcabd3-ae29-41b5-9e7c-381aaafe3780 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:54.570517 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-eabcabd3-ae29-41b5-9e7c-381aaafe3780 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:54.577457 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-ed39d8c6-eab1-451b-a2b6-9ede8d2aa172 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:54.579347 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-ed39d8c6-eab1-451b-a2b6-9ede8d2aa172 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:54.582714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-ed39d8c6-eab1-451b-a2b6-9ede8d2aa172 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1738 microversion: 2.20 time: 0.487594 Aug 19 21:12:54.598768 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 223/479] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:54 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1738 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:54.609982 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eabcabd3-ae29-41b5-9e7c-381aaafe3780 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:54.610600 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eabcabd3-ae29-41b5-9e7c-381aaafe3780 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:54.613439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eabcabd3-ae29-41b5-9e7c-381aaafe3780 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:54.613439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eabcabd3-ae29-41b5-9e7c-381aaafe3780 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:54.613439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eabcabd3-ae29-41b5-9e7c-381aaafe3780 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:54.613439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eabcabd3-ae29-41b5-9e7c-381aaafe3780 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:54.965945 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-eabcabd3-ae29-41b5-9e7c-381aaafe3780 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:54.978919 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-eabcabd3-ae29-41b5-9e7c-381aaafe3780 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1724 microversion: 2.1 time: 0.420613 Aug 19 21:12:54.990439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 257/480] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:54 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1724 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:12:55.613161 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-b689aa61-ec29-40f4-aaa1-dbd420e97bb1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:55.614301 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-b689aa61-ec29-40f4-aaa1-dbd420e97bb1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:55.630922 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b689aa61-ec29-40f4-aaa1-dbd420e97bb1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:55.631664 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b689aa61-ec29-40f4-aaa1-dbd420e97bb1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:55.632266 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b689aa61-ec29-40f4-aaa1-dbd420e97bb1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:55.633141 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b689aa61-ec29-40f4-aaa1-dbd420e97bb1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:55.644390 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b689aa61-ec29-40f4-aaa1-dbd420e97bb1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:55.645454 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b689aa61-ec29-40f4-aaa1-dbd420e97bb1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:55.957012 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b689aa61-ec29-40f4-aaa1-dbd420e97bb1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:55.968640 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b689aa61-ec29-40f4-aaa1-dbd420e97bb1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:55.970250 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b689aa61-ec29-40f4-aaa1-dbd420e97bb1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:55.971484 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-b689aa61-ec29-40f4-aaa1-dbd420e97bb1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1738 microversion: 2.20 time: 0.363883 Aug 19 21:12:55.972781 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 224/481] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:55 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1738 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:56.005517 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0120905e-7112-4167-adfb-daca39e529d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:56.006517 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0120905e-7112-4167-adfb-daca39e529d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:56.013976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0120905e-7112-4167-adfb-daca39e529d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:56.015001 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0120905e-7112-4167-adfb-daca39e529d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:56.015693 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0120905e-7112-4167-adfb-daca39e529d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:56.017080 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0120905e-7112-4167-adfb-daca39e529d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:56.017789 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0120905e-7112-4167-adfb-daca39e529d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:56.018412 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0120905e-7112-4167-adfb-daca39e529d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:56.219058 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0120905e-7112-4167-adfb-daca39e529d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:56.237267 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0120905e-7112-4167-adfb-daca39e529d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1701 microversion: 2.1 time: 0.236019 Aug 19 21:12:56.240030 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 258/482] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:55 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1701 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:56.264700 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-fa99fd18-b280-4b74-9a01-faeb68b570dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:12:56.276614 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fa99fd18-b280-4b74-9a01-faeb68b570dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:56.277597 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fa99fd18-b280-4b74-9a01-faeb68b570dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:56.278467 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fa99fd18-b280-4b74-9a01-faeb68b570dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:56.370138 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-fa99fd18-b280-4b74-9a01-faeb68b570dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Going to try to start instance {{(pid=120876) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 19 21:12:56.446409 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-fa99fd18-b280-4b74-9a01-faeb68b570dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "POST /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e/action" status: 202 len: 0 microversion: 2.1 time: 0.188034 Aug 19 21:12:56.451361 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 225/483] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Aug 19 21:12:56 2022] POST /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:12:56.460662 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-20b11160-8ec4-4174-bc5d-6e8073601e49 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:56.461691 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-20b11160-8ec4-4174-bc5d-6e8073601e49 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:56.470367 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-20b11160-8ec4-4174-bc5d-6e8073601e49 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:56.471669 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-20b11160-8ec4-4174-bc5d-6e8073601e49 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:56.473837 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-20b11160-8ec4-4174-bc5d-6e8073601e49 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:56.475515 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-20b11160-8ec4-4174-bc5d-6e8073601e49 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:56.476372 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-20b11160-8ec4-4174-bc5d-6e8073601e49 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:56.477373 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-20b11160-8ec4-4174-bc5d-6e8073601e49 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:56.715723 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-20b11160-8ec4-4174-bc5d-6e8073601e49 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:56.735067 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-20b11160-8ec4-4174-bc5d-6e8073601e49 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1710 microversion: 2.1 time: 0.279985 Aug 19 21:12:56.756738 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 259/484] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:56 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1710 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:57.018160 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0a95052a-c3f3-40e2-9b32-49b978d97ba8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:57.022104 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0a95052a-c3f3-40e2-9b32-49b978d97ba8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:57.022869 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-64861ed1-80c3-4722-8aac-541041428092 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1892937100", "imageRef": "d1f034cf-f103-477b-bbb5-3298c678db05", "flavorRef": "452"}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:12:57.033939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0a95052a-c3f3-40e2-9b32-49b978d97ba8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:57.036992 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0a95052a-c3f3-40e2-9b32-49b978d97ba8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:57.039468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0a95052a-c3f3-40e2-9b32-49b978d97ba8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:57.043788 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0a95052a-c3f3-40e2-9b32-49b978d97ba8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:57.044294 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0a95052a-c3f3-40e2-9b32-49b978d97ba8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:57.044747 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0a95052a-c3f3-40e2-9b32-49b978d97ba8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:57.163690 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.network.neutron [None req-64861ed1-80c3-4722-8aac-541041428092 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] validate_networks() for None {{(pid=120876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 21:12:58.045094 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0a95052a-c3f3-40e2-9b32-49b978d97ba8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:58.054937 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0a95052a-c3f3-40e2-9b32-49b978d97ba8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:58.057125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0a95052a-c3f3-40e2-9b32-49b978d97ba8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:58.058564 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0a95052a-c3f3-40e2-9b32-49b978d97ba8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1738 microversion: 2.20 time: 1.046417 Aug 19 21:12:58.074190 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 260/485] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:57 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1738 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:58.081117 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-add61acf-7398-4ec6-a185-877cc12e04bd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:58.082427 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-add61acf-7398-4ec6-a185-877cc12e04bd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:58.098016 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-add61acf-7398-4ec6-a185-877cc12e04bd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:58.098900 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-add61acf-7398-4ec6-a185-877cc12e04bd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:58.099037 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-add61acf-7398-4ec6-a185-877cc12e04bd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:58.099919 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-add61acf-7398-4ec6-a185-877cc12e04bd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:58.100221 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-add61acf-7398-4ec6-a185-877cc12e04bd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:58.100647 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-add61acf-7398-4ec6-a185-877cc12e04bd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:58.373925 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-64861ed1-80c3-4722-8aac-541041428092 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Flavor limits 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 21:12:58.375926 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-64861ed1-80c3-4722-8aac-541041428092 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Image limits 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 21:12:58.377555 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-64861ed1-80c3-4722-8aac-541041428092 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Flavor pref 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 21:12:58.379824 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-64861ed1-80c3-4722-8aac-541041428092 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Image pref 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 21:12:58.382980 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-64861ed1-80c3-4722-8aac-541041428092 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 21:12:58.417234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-64861ed1-80c3-4722-8aac-541041428092 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:58.418763 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-64861ed1-80c3-4722-8aac-541041428092 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:58.419952 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-64861ed1-80c3-4722-8aac-541041428092 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:58.421692 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-64861ed1-80c3-4722-8aac-541041428092 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:58.423300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-64861ed1-80c3-4722-8aac-541041428092 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:58.424830 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-64861ed1-80c3-4722-8aac-541041428092 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:58.442937 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-add61acf-7398-4ec6-a185-877cc12e04bd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:58.469285 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-add61acf-7398-4ec6-a185-877cc12e04bd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1710 microversion: 2.1 time: 0.393101 Aug 19 21:12:58.483055 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 261/486] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:58 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1710 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:58.518347 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-64861ed1-80c3-4722-8aac-541041428092 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Getting quotas for project 7f34422d436a4dbeb7102d599f7996d0. Resources: {'cores', 'ram', 'instances'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:12:58.530432 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-64861ed1-80c3-4722-8aac-541041428092 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Getting quotas for user b526a58b0c4f49739545419d1fa1feca and project 7f34422d436a4dbeb7102d599f7996d0. Resources: {'cores', 'ram', 'instances'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:12:58.564147 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-64861ed1-80c3-4722-8aac-541041428092 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Going to run 1 instances... {{(pid=120876) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 21:12:58.567175 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-64861ed1-80c3-4722-8aac-541041428092 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f034cf-f103-477b-bbb5-3298c678db05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 21:12:58.666843 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-64861ed1-80c3-4722-8aac-541041428092 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.655908 Aug 19 21:12:58.674383 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 226/487] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Aug 19 21:12:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 21:12:58.683893 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a531da9b-06c3-448e-b371-cc99799c668a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:58.687241 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-a531da9b-06c3-448e-b371-cc99799c668a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:58.813031 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-a531da9b-06c3-448e-b371-cc99799c668a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:58.832177 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-a531da9b-06c3-448e-b371-cc99799c668a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1215 microversion: 2.1 time: 0.154718 Aug 19 21:12:58.849818 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 262/488] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:58 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1215 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:59.086085 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-30c5b472-d139-4866-9769-92f1a09d57b0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:59.086817 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-30c5b472-d139-4866-9769-92f1a09d57b0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:59.097669 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-30c5b472-d139-4866-9769-92f1a09d57b0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:59.098271 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-30c5b472-d139-4866-9769-92f1a09d57b0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:59.098830 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-30c5b472-d139-4866-9769-92f1a09d57b0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:59.100557 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-30c5b472-d139-4866-9769-92f1a09d57b0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:59.100557 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-30c5b472-d139-4866-9769-92f1a09d57b0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:59.102860 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-30c5b472-d139-4866-9769-92f1a09d57b0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:59.371725 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-30c5b472-d139-4866-9769-92f1a09d57b0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:59.393971 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-30c5b472-d139-4866-9769-92f1a09d57b0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:59.398309 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-30c5b472-d139-4866-9769-92f1a09d57b0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:59.401367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-30c5b472-d139-4866-9769-92f1a09d57b0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1738 microversion: 2.20 time: 0.319885 Aug 19 21:12:59.418968 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 227/489] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:12:59 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1738 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:12:59.525027 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-f0c36386-b72d-4fc7-8100-a58ff73974bd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:59.526258 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-f0c36386-b72d-4fc7-8100-a58ff73974bd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:59.541631 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f0c36386-b72d-4fc7-8100-a58ff73974bd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:59.541631 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f0c36386-b72d-4fc7-8100-a58ff73974bd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:59.541994 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f0c36386-b72d-4fc7-8100-a58ff73974bd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:59.543292 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f0c36386-b72d-4fc7-8100-a58ff73974bd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:59.544313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f0c36386-b72d-4fc7-8100-a58ff73974bd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:59.545113 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f0c36386-b72d-4fc7-8100-a58ff73974bd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:59.746678 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-f0c36386-b72d-4fc7-8100-a58ff73974bd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:59.763441 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-f0c36386-b72d-4fc7-8100-a58ff73974bd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1714 microversion: 2.1 time: 0.246131 Aug 19 21:12:59.764417 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 263/490] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:59 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1714 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:12:59.865039 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-2f346ba3-0cc6-45f1-8242-fb1f9fc64b1c tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:12:59.865665 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-2f346ba3-0cc6-45f1-8242-fb1f9fc64b1c tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:12:59.872745 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2f346ba3-0cc6-45f1-8242-fb1f9fc64b1c tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:59.873519 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2f346ba3-0cc6-45f1-8242-fb1f9fc64b1c tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:59.874178 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2f346ba3-0cc6-45f1-8242-fb1f9fc64b1c tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:59.875089 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2f346ba3-0cc6-45f1-8242-fb1f9fc64b1c tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:12:59.875720 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2f346ba3-0cc6-45f1-8242-fb1f9fc64b1c tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:12:59.876322 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2f346ba3-0cc6-45f1-8242-fb1f9fc64b1c tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:12:59.987524 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-2f346ba3-0cc6-45f1-8242-fb1f9fc64b1c tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:12:59.996591 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-2f346ba3-0cc6-45f1-8242-fb1f9fc64b1c tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1219 microversion: 2.1 time: 0.135446 Aug 19 21:12:59.997176 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 228/491] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:12:59 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1219 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:00.443507 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ea49303b-e7ce-4131-b207-3e01c9845e60 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:00.444033 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ea49303b-e7ce-4131-b207-3e01c9845e60 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:00.451172 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea49303b-e7ce-4131-b207-3e01c9845e60 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:00.451662 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea49303b-e7ce-4131-b207-3e01c9845e60 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:00.452098 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea49303b-e7ce-4131-b207-3e01c9845e60 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:00.452833 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea49303b-e7ce-4131-b207-3e01c9845e60 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:00.453284 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea49303b-e7ce-4131-b207-3e01c9845e60 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:00.453707 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea49303b-e7ce-4131-b207-3e01c9845e60 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:00.651752 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ea49303b-e7ce-4131-b207-3e01c9845e60 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:00.662022 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ea49303b-e7ce-4131-b207-3e01c9845e60 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:00.663972 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ea49303b-e7ce-4131-b207-3e01c9845e60 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:00.665440 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ea49303b-e7ce-4131-b207-3e01c9845e60 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1738 microversion: 2.20 time: 0.227059 Aug 19 21:13:00.681587 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 264/492] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:00 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:13:01.019476 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-25035599-df6e-4472-ab03-aaba95443316 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:01.020318 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-25035599-df6e-4472-ab03-aaba95443316 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:01.027215 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-25035599-df6e-4472-ab03-aaba95443316 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:01.027711 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-25035599-df6e-4472-ab03-aaba95443316 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:01.028144 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-25035599-df6e-4472-ab03-aaba95443316 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:01.028878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-25035599-df6e-4472-ab03-aaba95443316 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:01.029345 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-25035599-df6e-4472-ab03-aaba95443316 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:01.029796 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-25035599-df6e-4472-ab03-aaba95443316 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:01.132414 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-25035599-df6e-4472-ab03-aaba95443316 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:01.143477 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-25035599-df6e-4472-ab03-aaba95443316 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1273 microversion: 2.1 time: 0.128492 Aug 19 21:13:01.145549 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 229/493] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:01 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1273 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:01.688654 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8976439f-a636-4d48-8e40-f32067eff3c4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:01.690391 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8976439f-a636-4d48-8e40-f32067eff3c4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:01.702057 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8976439f-a636-4d48-8e40-f32067eff3c4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:01.702855 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8976439f-a636-4d48-8e40-f32067eff3c4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:01.703805 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8976439f-a636-4d48-8e40-f32067eff3c4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:01.705707 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8976439f-a636-4d48-8e40-f32067eff3c4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:01.707599 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8976439f-a636-4d48-8e40-f32067eff3c4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:01.708320 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8976439f-a636-4d48-8e40-f32067eff3c4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:02.022426 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8976439f-a636-4d48-8e40-f32067eff3c4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:02.039519 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8976439f-a636-4d48-8e40-f32067eff3c4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:02.041433 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8976439f-a636-4d48-8e40-f32067eff3c4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:02.043160 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8976439f-a636-4d48-8e40-f32067eff3c4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1720 microversion: 2.20 time: 0.358303 Aug 19 21:13:02.043942 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 265/494] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:01 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1720 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:13:02.171170 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-9a7d0c00-73b9-4253-8b2d-007d07fcdb7f tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:02.172488 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-9a7d0c00-73b9-4253-8b2d-007d07fcdb7f tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:02.181914 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9a7d0c00-73b9-4253-8b2d-007d07fcdb7f tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:02.182792 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9a7d0c00-73b9-4253-8b2d-007d07fcdb7f tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:02.183379 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9a7d0c00-73b9-4253-8b2d-007d07fcdb7f tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:02.184364 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9a7d0c00-73b9-4253-8b2d-007d07fcdb7f tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:02.185065 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9a7d0c00-73b9-4253-8b2d-007d07fcdb7f tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:02.185566 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9a7d0c00-73b9-4253-8b2d-007d07fcdb7f tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:02.442919 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9a7d0c00-73b9-4253-8b2d-007d07fcdb7f tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:02.450774 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-9a7d0c00-73b9-4253-8b2d-007d07fcdb7f tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.287144 Aug 19 21:13:02.451552 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 230/495] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:02 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:02.526332 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-2aeb58ae-5a4d-4cdc-95cc-243fb35939ab req-95a24834-c8e4-4598-b8b0-aab735ca87b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26ca6bb6-a021-425d-8615-2a75cd09a479", "tag": "35ce9460-2752-4e73-a438-9f45f0d7b3d0"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:13:02.536794 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-2aeb58ae-5a4d-4cdc-95cc-243fb35939ab req-95a24834-c8e4-4598-b8b0-aab735ca87b0 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:02.537193 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-2aeb58ae-5a4d-4cdc-95cc-243fb35939ab req-95a24834-c8e4-4598-b8b0-aab735ca87b0 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:02.537628 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-2aeb58ae-5a4d-4cdc-95cc-243fb35939ab req-95a24834-c8e4-4598-b8b0-aab735ca87b0 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:02.549082 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-2aeb58ae-5a4d-4cdc-95cc-243fb35939ab req-95a24834-c8e4-4598-b8b0-aab735ca87b0 service nova] Creating event network-changed:35ce9460-2752-4e73-a438-9f45f0d7b3d0 for instance 26ca6bb6-a021-425d-8615-2a75cd09a479 on hv-cinder-85220 Aug 19 21:13:02.554877 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-2aeb58ae-5a4d-4cdc-95cc-243fb35939ab req-95a24834-c8e4-4598-b8b0-aab735ca87b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032219 Aug 19 21:13:02.555548 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 266/496] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:13:03.068223 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-1816ffb3-9ff2-484c-b619-ab95e1b8014a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:03.068841 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-1816ffb3-9ff2-484c-b619-ab95e1b8014a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:03.075233 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1816ffb3-9ff2-484c-b619-ab95e1b8014a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:03.075723 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1816ffb3-9ff2-484c-b619-ab95e1b8014a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:03.076224 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1816ffb3-9ff2-484c-b619-ab95e1b8014a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:03.076845 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1816ffb3-9ff2-484c-b619-ab95e1b8014a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:03.077620 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1816ffb3-9ff2-484c-b619-ab95e1b8014a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:03.078067 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1816ffb3-9ff2-484c-b619-ab95e1b8014a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:03.229665 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-1816ffb3-9ff2-484c-b619-ab95e1b8014a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:03.240725 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-1816ffb3-9ff2-484c-b619-ab95e1b8014a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:03.243111 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-1816ffb3-9ff2-484c-b619-ab95e1b8014a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:03.244283 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-1816ffb3-9ff2-484c-b619-ab95e1b8014a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1720 microversion: 2.20 time: 0.180164 Aug 19 21:13:03.244839 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 231/497] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:03 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1720 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:13:03.473158 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-52b2088b-04a1-4300-a4da-53083f0a754a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:03.474170 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-52b2088b-04a1-4300-a4da-53083f0a754a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:03.481330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-52b2088b-04a1-4300-a4da-53083f0a754a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:03.481843 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-52b2088b-04a1-4300-a4da-53083f0a754a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:03.482283 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-52b2088b-04a1-4300-a4da-53083f0a754a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:03.482977 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-52b2088b-04a1-4300-a4da-53083f0a754a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:03.483429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-52b2088b-04a1-4300-a4da-53083f0a754a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:03.483843 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-52b2088b-04a1-4300-a4da-53083f0a754a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:03.631150 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-52b2088b-04a1-4300-a4da-53083f0a754a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:03.638985 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-52b2088b-04a1-4300-a4da-53083f0a754a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.170710 Aug 19 21:13:03.639549 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 267/498] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:03 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:04.278710 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-419d5fd0-b1bb-40e9-a5a2-606c7fba89cf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:04.280756 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-419d5fd0-b1bb-40e9-a5a2-606c7fba89cf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:04.293162 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-419d5fd0-b1bb-40e9-a5a2-606c7fba89cf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:04.294086 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-419d5fd0-b1bb-40e9-a5a2-606c7fba89cf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:04.294950 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-419d5fd0-b1bb-40e9-a5a2-606c7fba89cf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:04.296300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-419d5fd0-b1bb-40e9-a5a2-606c7fba89cf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:04.297678 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-419d5fd0-b1bb-40e9-a5a2-606c7fba89cf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:04.298484 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-419d5fd0-b1bb-40e9-a5a2-606c7fba89cf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:04.496831 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-419d5fd0-b1bb-40e9-a5a2-606c7fba89cf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:04.506128 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-419d5fd0-b1bb-40e9-a5a2-606c7fba89cf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:04.507643 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-419d5fd0-b1bb-40e9-a5a2-606c7fba89cf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:04.508820 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-419d5fd0-b1bb-40e9-a5a2-606c7fba89cf tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1720 microversion: 2.20 time: 0.237821 Aug 19 21:13:04.509381 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 232/499] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:04 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1720 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:13:04.660522 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-f051d2b6-d968-454a-95d6-9e836885334a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:04.661482 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-f051d2b6-d968-454a-95d6-9e836885334a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:04.668387 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f051d2b6-d968-454a-95d6-9e836885334a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:04.669038 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f051d2b6-d968-454a-95d6-9e836885334a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:04.669502 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f051d2b6-d968-454a-95d6-9e836885334a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:04.670241 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f051d2b6-d968-454a-95d6-9e836885334a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:04.671016 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f051d2b6-d968-454a-95d6-9e836885334a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:04.671130 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f051d2b6-d968-454a-95d6-9e836885334a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:04.908795 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-3e542e77-d1c1-44d8-b08c-af314a5e3012 req-0ffb908f-90f9-44a0-910e-4490ab8d187e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95c060a-e4cc-436c-a185-9345fd2c44f2", "name": "network-vif-unplugged", "status": "completed", "tag": "c65527c3-278b-404c-9369-abd76c37a0b5"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:13:04.917820 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-f051d2b6-d968-454a-95d6-9e836885334a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:04.928811 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-3e542e77-d1c1-44d8-b08c-af314a5e3012 req-0ffb908f-90f9-44a0-910e-4490ab8d187e service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:04.929376 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-3e542e77-d1c1-44d8-b08c-af314a5e3012 req-0ffb908f-90f9-44a0-910e-4490ab8d187e service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:04.929864 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-3e542e77-d1c1-44d8-b08c-af314a5e3012 req-0ffb908f-90f9-44a0-910e-4490ab8d187e service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:04.935805 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-f051d2b6-d968-454a-95d6-9e836885334a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.279895 Aug 19 21:13:04.946914 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 268/500] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:04 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:04.954891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.compute.server_external_events [req-3e542e77-d1c1-44d8-b08c-af314a5e3012 req-0ffb908f-90f9-44a0-910e-4490ab8d187e service nova] Unable to find a host for instance f95c060a-e4cc-436c-a185-9345fd2c44f2. Dropping event network-vif-unplugged {{(pid=120876) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 19 21:13:04.955949 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-3e542e77-d1c1-44d8-b08c-af314a5e3012 req-0ffb908f-90f9-44a0-910e-4490ab8d187e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.051398 Aug 19 21:13:04.957406 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 233/501] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 53 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 19 21:13:05.532973 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c6b6e0ae-b851-4bd8-9a6b-b435bd274edd tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:05.533569 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-c6b6e0ae-b851-4bd8-9a6b-b435bd274edd tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:05.540372 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c6b6e0ae-b851-4bd8-9a6b-b435bd274edd tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:05.540852 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c6b6e0ae-b851-4bd8-9a6b-b435bd274edd tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:05.541278 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c6b6e0ae-b851-4bd8-9a6b-b435bd274edd tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:05.541989 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c6b6e0ae-b851-4bd8-9a6b-b435bd274edd tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:05.542434 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c6b6e0ae-b851-4bd8-9a6b-b435bd274edd tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:05.542849 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c6b6e0ae-b851-4bd8-9a6b-b435bd274edd tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:05.680188 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c6b6e0ae-b851-4bd8-9a6b-b435bd274edd tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:05.688561 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c6b6e0ae-b851-4bd8-9a6b-b435bd274edd tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:05.690173 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c6b6e0ae-b851-4bd8-9a6b-b435bd274edd tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:05.691315 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-c6b6e0ae-b851-4bd8-9a6b-b435bd274edd tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1663 microversion: 2.20 time: 0.162738 Aug 19 21:13:05.691873 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 269/502] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:05 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:13:05.714647 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-77115f9d-d8f7-4dc9-a597-5bec4b6cf902 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cd91dd9-d5cf-4a17-9f3e-35f1d8f57d76"}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:13:05.717130 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-77115f9d-d8f7-4dc9-a597-5bec4b6cf902 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:05.724586 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-77115f9d-d8f7-4dc9-a597-5bec4b6cf902 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:05.725067 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-77115f9d-d8f7-4dc9-a597-5bec4b6cf902 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:05.725503 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-77115f9d-d8f7-4dc9-a597-5bec4b6cf902 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:05.726262 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-77115f9d-d8f7-4dc9-a597-5bec4b6cf902 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:05.726712 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-77115f9d-d8f7-4dc9-a597-5bec4b6cf902 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:05.727162 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-77115f9d-d8f7-4dc9-a597-5bec4b6cf902 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:05.959691 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c497b006-54b2-4c0a-a53d-6eb8bf46f3b0 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:05.960217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-c497b006-54b2-4c0a-a53d-6eb8bf46f3b0 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:05.966779 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c497b006-54b2-4c0a-a53d-6eb8bf46f3b0 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:05.967275 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c497b006-54b2-4c0a-a53d-6eb8bf46f3b0 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:05.967714 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c497b006-54b2-4c0a-a53d-6eb8bf46f3b0 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:05.968507 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c497b006-54b2-4c0a-a53d-6eb8bf46f3b0 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:05.969152 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c497b006-54b2-4c0a-a53d-6eb8bf46f3b0 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:05.971708 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c497b006-54b2-4c0a-a53d-6eb8bf46f3b0 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:06.073316 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-77115f9d-d8f7-4dc9-a597-5bec4b6cf902 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "POST /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.362659 Aug 19 21:13:06.073970 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 234/503] 10.222.0.16 () {62 vars in 1364 bytes} [Fri Aug 19 21:13:05 2022] POST /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2/os-volume_attachments => generated 188 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 21:13:06.121365 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c497b006-54b2-4c0a-a53d-6eb8bf46f3b0 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:06.130324 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-c497b006-54b2-4c0a-a53d-6eb8bf46f3b0 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.174818 Aug 19 21:13:06.130994 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 270/504] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:05 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:06.210732 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-ff6a5402-f95c-453f-a286-aa6e5f2580b1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:13:06.211229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-ff6a5402-f95c-453f-a286-aa6e5f2580b1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:06.218268 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ff6a5402-f95c-453f-a286-aa6e5f2580b1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:06.218762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ff6a5402-f95c-453f-a286-aa6e5f2580b1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:06.219192 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ff6a5402-f95c-453f-a286-aa6e5f2580b1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:06.219943 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ff6a5402-f95c-453f-a286-aa6e5f2580b1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:06.220353 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ff6a5402-f95c-453f-a286-aa6e5f2580b1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:06.220773 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ff6a5402-f95c-453f-a286-aa6e5f2580b1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:06.266116 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-ff6a5402-f95c-453f-a286-aa6e5f2580b1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120876) unshelve /opt/stack/nova/nova/compute/api.py:4584}} Aug 19 21:13:06.325626 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:13:06.341139 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-ff6a5402-f95c-453f-a286-aa6e5f2580b1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "POST /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2/action" status: 202 len: 0 microversion: 2.20 time: 0.135276 Aug 19 21:13:06.344635 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 235/505] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Aug 19 21:13:06 2022] POST /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 19 21:13:06.350351 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ed026b6f-b2f5-4d03-be04-f7a46fcc74eb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:06.350978 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ed026b6f-b2f5-4d03-be04-f7a46fcc74eb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:06.357147 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ed026b6f-b2f5-4d03-be04-f7a46fcc74eb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:06.357555 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ed026b6f-b2f5-4d03-be04-f7a46fcc74eb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:06.358019 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ed026b6f-b2f5-4d03-be04-f7a46fcc74eb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:06.358730 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ed026b6f-b2f5-4d03-be04-f7a46fcc74eb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:06.359185 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ed026b6f-b2f5-4d03-be04-f7a46fcc74eb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:06.359638 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ed026b6f-b2f5-4d03-be04-f7a46fcc74eb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:06.505619 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ed026b6f-b2f5-4d03-be04-f7a46fcc74eb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:06.514841 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ed026b6f-b2f5-4d03-be04-f7a46fcc74eb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:06.516416 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ed026b6f-b2f5-4d03-be04-f7a46fcc74eb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:06.517593 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ed026b6f-b2f5-4d03-be04-f7a46fcc74eb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1749 microversion: 2.20 time: 0.171677 Aug 19 21:13:06.518182 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 271/506] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:06 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:13:07.152194 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-86e5c7d5-9634-406f-ae95-6eb1778f7b91 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:07.153042 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-86e5c7d5-9634-406f-ae95-6eb1778f7b91 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:07.161502 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-86e5c7d5-9634-406f-ae95-6eb1778f7b91 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:07.162019 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-86e5c7d5-9634-406f-ae95-6eb1778f7b91 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:07.162451 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-86e5c7d5-9634-406f-ae95-6eb1778f7b91 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:07.163176 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-86e5c7d5-9634-406f-ae95-6eb1778f7b91 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:07.163622 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-86e5c7d5-9634-406f-ae95-6eb1778f7b91 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:07.164034 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-86e5c7d5-9634-406f-ae95-6eb1778f7b91 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:07.307916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-86e5c7d5-9634-406f-ae95-6eb1778f7b91 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:07.316161 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-86e5c7d5-9634-406f-ae95-6eb1778f7b91 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.168748 Aug 19 21:13:07.316755 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 236/507] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:07 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:07.541572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-6fcf0834-58ca-4fa0-bf3d-26a650fad46f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:07.542211 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-6fcf0834-58ca-4fa0-bf3d-26a650fad46f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:07.549069 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6fcf0834-58ca-4fa0-bf3d-26a650fad46f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:07.549551 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6fcf0834-58ca-4fa0-bf3d-26a650fad46f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:07.550373 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6fcf0834-58ca-4fa0-bf3d-26a650fad46f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:07.550720 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6fcf0834-58ca-4fa0-bf3d-26a650fad46f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:07.551164 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6fcf0834-58ca-4fa0-bf3d-26a650fad46f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:07.551593 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6fcf0834-58ca-4fa0-bf3d-26a650fad46f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:07.738464 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-6fcf0834-58ca-4fa0-bf3d-26a650fad46f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:07.747277 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-6fcf0834-58ca-4fa0-bf3d-26a650fad46f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:07.748813 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-6fcf0834-58ca-4fa0-bf3d-26a650fad46f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:07.750038 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-6fcf0834-58ca-4fa0-bf3d-26a650fad46f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1749 microversion: 2.20 time: 0.212311 Aug 19 21:13:07.750600 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 272/508] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:07 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1749 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:13:08.341358 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-210a4058-4d5a-4ebf-8533-5cf37ea86861 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:08.341914 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-210a4058-4d5a-4ebf-8533-5cf37ea86861 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:08.349251 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-210a4058-4d5a-4ebf-8533-5cf37ea86861 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:08.349756 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-210a4058-4d5a-4ebf-8533-5cf37ea86861 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:08.350210 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-210a4058-4d5a-4ebf-8533-5cf37ea86861 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:08.350919 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-210a4058-4d5a-4ebf-8533-5cf37ea86861 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:08.351372 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-210a4058-4d5a-4ebf-8533-5cf37ea86861 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:08.351802 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-210a4058-4d5a-4ebf-8533-5cf37ea86861 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:08.474884 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=2 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:13:08.543727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=6 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:13:08.552272 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-210a4058-4d5a-4ebf-8533-5cf37ea86861 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:08.560097 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-210a4058-4d5a-4ebf-8533-5cf37ea86861 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.223423 Aug 19 21:13:08.560704 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 237/509] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:08 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:08.776509 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-dab225e6-a3ff-4028-9069-1edcd5b20e97 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:08.777325 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-dab225e6-a3ff-4028-9069-1edcd5b20e97 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:08.786717 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dab225e6-a3ff-4028-9069-1edcd5b20e97 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:08.787134 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dab225e6-a3ff-4028-9069-1edcd5b20e97 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:08.787868 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dab225e6-a3ff-4028-9069-1edcd5b20e97 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:08.788774 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dab225e6-a3ff-4028-9069-1edcd5b20e97 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:08.789625 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dab225e6-a3ff-4028-9069-1edcd5b20e97 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:08.790416 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dab225e6-a3ff-4028-9069-1edcd5b20e97 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:08.823870 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=2 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:13:08.943203 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-dab225e6-a3ff-4028-9069-1edcd5b20e97 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:08.956600 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-dab225e6-a3ff-4028-9069-1edcd5b20e97 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:08.958386 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-dab225e6-a3ff-4028-9069-1edcd5b20e97 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:08.959658 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-dab225e6-a3ff-4028-9069-1edcd5b20e97 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1751 microversion: 2.20 time: 0.189618 Aug 19 21:13:08.960230 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 273/510] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:08 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1751 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:13:09.584056 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-44cc3e17-908f-421a-9eea-05c14a1221b9 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:09.585405 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-44cc3e17-908f-421a-9eea-05c14a1221b9 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:09.592880 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-44cc3e17-908f-421a-9eea-05c14a1221b9 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:09.593158 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-44cc3e17-908f-421a-9eea-05c14a1221b9 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:09.593674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-44cc3e17-908f-421a-9eea-05c14a1221b9 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:09.594327 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-44cc3e17-908f-421a-9eea-05c14a1221b9 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:09.594860 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-44cc3e17-908f-421a-9eea-05c14a1221b9 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:09.595355 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-44cc3e17-908f-421a-9eea-05c14a1221b9 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:09.818230 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-44cc3e17-908f-421a-9eea-05c14a1221b9 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:09.825868 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-44cc3e17-908f-421a-9eea-05c14a1221b9 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.246905 Aug 19 21:13:09.826675 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 238/511] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:09 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:09.993638 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-85364698-4e80-417a-934f-94935d911304 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:09.994311 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-85364698-4e80-417a-934f-94935d911304 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:09.996598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=74 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:13:10.002045 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-85364698-4e80-417a-934f-94935d911304 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:10.002531 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-85364698-4e80-417a-934f-94935d911304 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:10.003106 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-85364698-4e80-417a-934f-94935d911304 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:10.003811 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-85364698-4e80-417a-934f-94935d911304 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:10.004269 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-85364698-4e80-417a-934f-94935d911304 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:10.004965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-85364698-4e80-417a-934f-94935d911304 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:10.142416 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-85364698-4e80-417a-934f-94935d911304 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:10.145341 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=100 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:13:10.153428 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-85364698-4e80-417a-934f-94935d911304 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:10.154977 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-85364698-4e80-417a-934f-94935d911304 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:10.156171 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-85364698-4e80-417a-934f-94935d911304 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.166714 Aug 19 21:13:10.156719 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 274/512] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:09 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:13:10.850957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-fb9f36ee-b6ea-4c30-97e2-43f5accbb078 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:10.851712 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-fb9f36ee-b6ea-4c30-97e2-43f5accbb078 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:10.858726 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fb9f36ee-b6ea-4c30-97e2-43f5accbb078 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:10.859214 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fb9f36ee-b6ea-4c30-97e2-43f5accbb078 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:10.859642 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fb9f36ee-b6ea-4c30-97e2-43f5accbb078 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:10.860336 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fb9f36ee-b6ea-4c30-97e2-43f5accbb078 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:10.860832 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fb9f36ee-b6ea-4c30-97e2-43f5accbb078 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:10.861298 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fb9f36ee-b6ea-4c30-97e2-43f5accbb078 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:10.960667 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-5f895ab5-2c69-4d07-a010-d00948466ec4 req-fa12c0c3-a2f3-455b-88d5-e61598a3f2b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26ca6bb6-a021-425d-8615-2a75cd09a479", "name": "network-vif-plugged", "status": "completed", "tag": "35ce9460-2752-4e73-a438-9f45f0d7b3d0"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:13:10.970669 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-5f895ab5-2c69-4d07-a010-d00948466ec4 req-fa12c0c3-a2f3-455b-88d5-e61598a3f2b2 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:10.971170 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-5f895ab5-2c69-4d07-a010-d00948466ec4 req-fa12c0c3-a2f3-455b-88d5-e61598a3f2b2 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:10.973077 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-5f895ab5-2c69-4d07-a010-d00948466ec4 req-fa12c0c3-a2f3-455b-88d5-e61598a3f2b2 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:10.986230 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-5f895ab5-2c69-4d07-a010-d00948466ec4 req-fa12c0c3-a2f3-455b-88d5-e61598a3f2b2 service nova] Creating event network-vif-plugged:35ce9460-2752-4e73-a438-9f45f0d7b3d0 for instance 26ca6bb6-a021-425d-8615-2a75cd09a479 on hv-cinder-85220 Aug 19 21:13:10.992315 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-5f895ab5-2c69-4d07-a010-d00948466ec4 req-fa12c0c3-a2f3-455b-88d5-e61598a3f2b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035951 Aug 19 21:13:10.992573 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 275/513] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:13:11.029523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-fb9f36ee-b6ea-4c30-97e2-43f5accbb078 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:11.038257 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-fb9f36ee-b6ea-4c30-97e2-43f5accbb078 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.193513 Aug 19 21:13:11.039023 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 239/514] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:10 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:11.180176 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0099395c-6157-496f-adbb-5c2461fbe686 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:11.180879 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0099395c-6157-496f-adbb-5c2461fbe686 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:11.187394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0099395c-6157-496f-adbb-5c2461fbe686 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:11.187877 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0099395c-6157-496f-adbb-5c2461fbe686 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:11.188315 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0099395c-6157-496f-adbb-5c2461fbe686 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:11.189009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0099395c-6157-496f-adbb-5c2461fbe686 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:11.189460 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0099395c-6157-496f-adbb-5c2461fbe686 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:11.189923 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0099395c-6157-496f-adbb-5c2461fbe686 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:11.338665 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0099395c-6157-496f-adbb-5c2461fbe686 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:11.349615 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0099395c-6157-496f-adbb-5c2461fbe686 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:11.351932 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0099395c-6157-496f-adbb-5c2461fbe686 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:11.353504 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0099395c-6157-496f-adbb-5c2461fbe686 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.178745 Aug 19 21:13:11.365815 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 276/515] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:11 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:13:11.746581 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-cdac3b07-ad41-46f1-b7a7-6021dd176b11 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7eb9ec7-6490-41fc-959e-4c2f4cec33b1"}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:13:11.749189 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-cdac3b07-ad41-46f1-b7a7-6021dd176b11 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:11.757635 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cdac3b07-ad41-46f1-b7a7-6021dd176b11 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:11.765498 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cdac3b07-ad41-46f1-b7a7-6021dd176b11 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:11.766128 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cdac3b07-ad41-46f1-b7a7-6021dd176b11 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:11.767809 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cdac3b07-ad41-46f1-b7a7-6021dd176b11 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:11.768276 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cdac3b07-ad41-46f1-b7a7-6021dd176b11 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:11.768960 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cdac3b07-ad41-46f1-b7a7-6021dd176b11 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:12.059526 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-39f31a50-906c-4a86-9e2a-ec4c09d525f4 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:12.060165 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-39f31a50-906c-4a86-9e2a-ec4c09d525f4 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:12.066339 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-39f31a50-906c-4a86-9e2a-ec4c09d525f4 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:12.066823 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-39f31a50-906c-4a86-9e2a-ec4c09d525f4 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:12.067256 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-39f31a50-906c-4a86-9e2a-ec4c09d525f4 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:12.067937 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-39f31a50-906c-4a86-9e2a-ec4c09d525f4 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:12.068392 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-39f31a50-906c-4a86-9e2a-ec4c09d525f4 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:12.068836 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-39f31a50-906c-4a86-9e2a-ec4c09d525f4 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:12.226137 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-39f31a50-906c-4a86-9e2a-ec4c09d525f4 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:12.234117 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-39f31a50-906c-4a86-9e2a-ec4c09d525f4 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.178442 Aug 19 21:13:12.234684 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 277/516] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:12 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:13:12.376817 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-5286880c-7696-48a5-a4cc-5117d804da40 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:12.377337 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-5286880c-7696-48a5-a4cc-5117d804da40 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:12.385336 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5286880c-7696-48a5-a4cc-5117d804da40 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:12.386136 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5286880c-7696-48a5-a4cc-5117d804da40 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:12.386643 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5286880c-7696-48a5-a4cc-5117d804da40 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:12.387562 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5286880c-7696-48a5-a4cc-5117d804da40 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:12.388094 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5286880c-7696-48a5-a4cc-5117d804da40 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:12.388651 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5286880c-7696-48a5-a4cc-5117d804da40 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:12.546748 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-5286880c-7696-48a5-a4cc-5117d804da40 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:12.556013 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-5286880c-7696-48a5-a4cc-5117d804da40 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:12.557543 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-5286880c-7696-48a5-a4cc-5117d804da40 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:12.558730 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-5286880c-7696-48a5-a4cc-5117d804da40 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.185910 Aug 19 21:13:12.559315 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 278/517] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:12 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:13:13.255359 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-eef97728-ab1a-40e3-8848-7b10b02bc001 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:13.256025 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-eef97728-ab1a-40e3-8848-7b10b02bc001 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:13.262696 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eef97728-ab1a-40e3-8848-7b10b02bc001 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:13.263195 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eef97728-ab1a-40e3-8848-7b10b02bc001 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:13.263823 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eef97728-ab1a-40e3-8848-7b10b02bc001 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:13.264576 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eef97728-ab1a-40e3-8848-7b10b02bc001 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:13.265036 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eef97728-ab1a-40e3-8848-7b10b02bc001 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:13.265467 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eef97728-ab1a-40e3-8848-7b10b02bc001 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:13.428100 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-eef97728-ab1a-40e3-8848-7b10b02bc001 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:13.437483 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-eef97728-ab1a-40e3-8848-7b10b02bc001 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.186355 Aug 19 21:13:13.449717 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 279/518] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:13 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:13:13.581935 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-57b2a70d-74b2-4efb-8bb0-8961de14d220 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:13.582547 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-57b2a70d-74b2-4efb-8bb0-8961de14d220 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:13.589201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-57b2a70d-74b2-4efb-8bb0-8961de14d220 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:13.589799 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-57b2a70d-74b2-4efb-8bb0-8961de14d220 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:13.590236 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-57b2a70d-74b2-4efb-8bb0-8961de14d220 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:13.590938 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-57b2a70d-74b2-4efb-8bb0-8961de14d220 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:13.591393 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-57b2a70d-74b2-4efb-8bb0-8961de14d220 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:13.591811 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-57b2a70d-74b2-4efb-8bb0-8961de14d220 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:13.727723 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-57b2a70d-74b2-4efb-8bb0-8961de14d220 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:13.736621 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-57b2a70d-74b2-4efb-8bb0-8961de14d220 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:13.738735 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-57b2a70d-74b2-4efb-8bb0-8961de14d220 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:13.739875 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-57b2a70d-74b2-4efb-8bb0-8961de14d220 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.162528 Aug 19 21:13:13.740428 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 280/519] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:13 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:13:14.459371 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-aebd03e2-1aae-4b5f-b455-0d208891bf06 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:14.460016 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-aebd03e2-1aae-4b5f-b455-0d208891bf06 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:14.466810 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-aebd03e2-1aae-4b5f-b455-0d208891bf06 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:14.467293 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-aebd03e2-1aae-4b5f-b455-0d208891bf06 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:14.467801 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-aebd03e2-1aae-4b5f-b455-0d208891bf06 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:14.468564 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-aebd03e2-1aae-4b5f-b455-0d208891bf06 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:14.469014 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-aebd03e2-1aae-4b5f-b455-0d208891bf06 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:14.469428 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-aebd03e2-1aae-4b5f-b455-0d208891bf06 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:14.623796 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-aebd03e2-1aae-4b5f-b455-0d208891bf06 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:14.632955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-aebd03e2-1aae-4b5f-b455-0d208891bf06 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.178390 Aug 19 21:13:14.633541 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 281/520] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:14 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:14.766075 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-95b692a5-dd37-4d63-afb6-21fdb108a10f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:14.766698 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-95b692a5-dd37-4d63-afb6-21fdb108a10f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:14.772779 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-95b692a5-dd37-4d63-afb6-21fdb108a10f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:14.773261 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-95b692a5-dd37-4d63-afb6-21fdb108a10f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:14.773728 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-95b692a5-dd37-4d63-afb6-21fdb108a10f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:14.774508 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-95b692a5-dd37-4d63-afb6-21fdb108a10f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:14.774959 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-95b692a5-dd37-4d63-afb6-21fdb108a10f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:14.775383 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-95b692a5-dd37-4d63-afb6-21fdb108a10f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:14.917516 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-95b692a5-dd37-4d63-afb6-21fdb108a10f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:14.929082 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-95b692a5-dd37-4d63-afb6-21fdb108a10f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:14.930683 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-95b692a5-dd37-4d63-afb6-21fdb108a10f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:14.931902 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-95b692a5-dd37-4d63-afb6-21fdb108a10f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.169855 Aug 19 21:13:14.933105 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 282/521] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:14 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:13:15.655701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-def9b568-b919-469a-818d-fffe74ca947d tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:15.656402 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-def9b568-b919-469a-818d-fffe74ca947d tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:15.670433 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-def9b568-b919-469a-818d-fffe74ca947d tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:15.677411 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-def9b568-b919-469a-818d-fffe74ca947d tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:15.677978 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-def9b568-b919-469a-818d-fffe74ca947d tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:15.678766 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-def9b568-b919-469a-818d-fffe74ca947d tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:15.679253 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-def9b568-b919-469a-818d-fffe74ca947d tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:15.679661 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-def9b568-b919-469a-818d-fffe74ca947d tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:15.823746 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-def9b568-b919-469a-818d-fffe74ca947d tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:15.838942 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-def9b568-b919-469a-818d-fffe74ca947d tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.186985 Aug 19 21:13:15.839846 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 283/522] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:15 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:13:15.956601 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-fe607e83-4234-40b3-91b9-0bdafad4fbb5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:15.957216 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-fe607e83-4234-40b3-91b9-0bdafad4fbb5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:15.964270 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fe607e83-4234-40b3-91b9-0bdafad4fbb5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:15.964777 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fe607e83-4234-40b3-91b9-0bdafad4fbb5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:15.965201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fe607e83-4234-40b3-91b9-0bdafad4fbb5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:15.965929 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fe607e83-4234-40b3-91b9-0bdafad4fbb5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:15.966380 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fe607e83-4234-40b3-91b9-0bdafad4fbb5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:15.966800 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fe607e83-4234-40b3-91b9-0bdafad4fbb5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:16.117297 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-fe607e83-4234-40b3-91b9-0bdafad4fbb5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:16.126277 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-fe607e83-4234-40b3-91b9-0bdafad4fbb5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:16.128372 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-fe607e83-4234-40b3-91b9-0bdafad4fbb5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:16.129518 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-fe607e83-4234-40b3-91b9-0bdafad4fbb5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.177573 Aug 19 21:13:16.130351 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 284/523] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:15 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:13:16.860445 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0cfc79f0-6b81-4dc1-ac7c-4e3e56366e0a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:16.861204 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0cfc79f0-6b81-4dc1-ac7c-4e3e56366e0a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:16.868418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0cfc79f0-6b81-4dc1-ac7c-4e3e56366e0a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:16.868918 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0cfc79f0-6b81-4dc1-ac7c-4e3e56366e0a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:16.869354 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0cfc79f0-6b81-4dc1-ac7c-4e3e56366e0a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:16.870088 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0cfc79f0-6b81-4dc1-ac7c-4e3e56366e0a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:16.870553 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0cfc79f0-6b81-4dc1-ac7c-4e3e56366e0a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:16.870974 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0cfc79f0-6b81-4dc1-ac7c-4e3e56366e0a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:17.024811 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0cfc79f0-6b81-4dc1-ac7c-4e3e56366e0a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:17.037446 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0cfc79f0-6b81-4dc1-ac7c-4e3e56366e0a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.180739 Aug 19 21:13:17.038070 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 285/524] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:16 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:13:17.155722 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-24883eae-484a-4604-ad4b-128565962792 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:17.156225 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-24883eae-484a-4604-ad4b-128565962792 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:17.163493 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-24883eae-484a-4604-ad4b-128565962792 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:17.164165 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-24883eae-484a-4604-ad4b-128565962792 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:17.164748 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-24883eae-484a-4604-ad4b-128565962792 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:17.165633 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-24883eae-484a-4604-ad4b-128565962792 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:17.166236 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-24883eae-484a-4604-ad4b-128565962792 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:17.166672 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-24883eae-484a-4604-ad4b-128565962792 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:17.603999 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-24883eae-484a-4604-ad4b-128565962792 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:17.613141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-24883eae-484a-4604-ad4b-128565962792 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:17.614688 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-24883eae-484a-4604-ad4b-128565962792 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:17.615867 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-24883eae-484a-4604-ad4b-128565962792 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.464242 Aug 19 21:13:17.616425 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 286/525] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:17 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:13:18.058625 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e7b44c54-271c-495d-aab5-aec66e2c821b tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:18.059316 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-e7b44c54-271c-495d-aab5-aec66e2c821b tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:18.069242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e7b44c54-271c-495d-aab5-aec66e2c821b tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:18.070173 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e7b44c54-271c-495d-aab5-aec66e2c821b tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:18.071066 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e7b44c54-271c-495d-aab5-aec66e2c821b tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:18.072234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e7b44c54-271c-495d-aab5-aec66e2c821b tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:18.073055 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e7b44c54-271c-495d-aab5-aec66e2c821b tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:18.073860 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e7b44c54-271c-495d-aab5-aec66e2c821b tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:18.250904 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e7b44c54-271c-495d-aab5-aec66e2c821b tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:18.261499 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e7b44c54-271c-495d-aab5-aec66e2c821b tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.206561 Aug 19 21:13:18.274471 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 287/526] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:18 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:13:18.640902 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3a9e0b4e-b2ef-4ef0-a5fa-ca08acc65b61 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:18.641515 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-3a9e0b4e-b2ef-4ef0-a5fa-ca08acc65b61 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:18.649326 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3a9e0b4e-b2ef-4ef0-a5fa-ca08acc65b61 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:18.649851 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3a9e0b4e-b2ef-4ef0-a5fa-ca08acc65b61 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:18.650294 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3a9e0b4e-b2ef-4ef0-a5fa-ca08acc65b61 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:18.651026 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3a9e0b4e-b2ef-4ef0-a5fa-ca08acc65b61 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:18.651494 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3a9e0b4e-b2ef-4ef0-a5fa-ca08acc65b61 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:18.652196 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3a9e0b4e-b2ef-4ef0-a5fa-ca08acc65b61 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:18.813644 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3a9e0b4e-b2ef-4ef0-a5fa-ca08acc65b61 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:18.826950 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3a9e0b4e-b2ef-4ef0-a5fa-ca08acc65b61 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:18.828513 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3a9e0b4e-b2ef-4ef0-a5fa-ca08acc65b61 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:18.829698 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-3a9e0b4e-b2ef-4ef0-a5fa-ca08acc65b61 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.192955 Aug 19 21:13:18.830283 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 288/527] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:18 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:13:19.283549 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-81e13721-b5c0-48f0-9ec9-13a068043656 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:19.284733 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-81e13721-b5c0-48f0-9ec9-13a068043656 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:19.292803 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-81e13721-b5c0-48f0-9ec9-13a068043656 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:19.293253 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-81e13721-b5c0-48f0-9ec9-13a068043656 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:19.293713 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-81e13721-b5c0-48f0-9ec9-13a068043656 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:19.294473 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-81e13721-b5c0-48f0-9ec9-13a068043656 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:19.294911 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-81e13721-b5c0-48f0-9ec9-13a068043656 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:19.295380 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-81e13721-b5c0-48f0-9ec9-13a068043656 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:19.478469 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-81e13721-b5c0-48f0-9ec9-13a068043656 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:19.486341 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-81e13721-b5c0-48f0-9ec9-13a068043656 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.206790 Aug 19 21:13:19.486982 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 289/528] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:19 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:13:19.854245 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a284e7a1-1328-4b42-8027-b45258df3ec0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:19.854844 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-a284e7a1-1328-4b42-8027-b45258df3ec0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:19.861490 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a284e7a1-1328-4b42-8027-b45258df3ec0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:19.861913 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a284e7a1-1328-4b42-8027-b45258df3ec0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:19.863511 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a284e7a1-1328-4b42-8027-b45258df3ec0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:19.864210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a284e7a1-1328-4b42-8027-b45258df3ec0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:19.864667 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a284e7a1-1328-4b42-8027-b45258df3ec0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:19.865084 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a284e7a1-1328-4b42-8027-b45258df3ec0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:20.025210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-a284e7a1-1328-4b42-8027-b45258df3ec0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:20.034904 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-a284e7a1-1328-4b42-8027-b45258df3ec0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:20.036430 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-a284e7a1-1328-4b42-8027-b45258df3ec0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:20.037574 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-a284e7a1-1328-4b42-8027-b45258df3ec0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.187310 Aug 19 21:13:20.038164 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 290/529] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:19 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:13:20.510757 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-33f937e4-1f7d-4a66-978c-d5fd0631d61e tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:20.511807 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-33f937e4-1f7d-4a66-978c-d5fd0631d61e tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:20.521459 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-33f937e4-1f7d-4a66-978c-d5fd0631d61e tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:20.521983 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-33f937e4-1f7d-4a66-978c-d5fd0631d61e tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:20.522423 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-33f937e4-1f7d-4a66-978c-d5fd0631d61e tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:20.523120 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-33f937e4-1f7d-4a66-978c-d5fd0631d61e tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:20.523573 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-33f937e4-1f7d-4a66-978c-d5fd0631d61e tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:20.523998 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-33f937e4-1f7d-4a66-978c-d5fd0631d61e tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:20.663455 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-33f937e4-1f7d-4a66-978c-d5fd0631d61e tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:20.671581 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-33f937e4-1f7d-4a66-978c-d5fd0631d61e tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.168172 Aug 19 21:13:20.673890 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 291/530] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:20 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:13:21.061432 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-fed8e424-8ccc-4e6f-a3b1-690b4e02bb28 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:21.062070 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-fed8e424-8ccc-4e6f-a3b1-690b4e02bb28 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:21.069506 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fed8e424-8ccc-4e6f-a3b1-690b4e02bb28 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:21.070033 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fed8e424-8ccc-4e6f-a3b1-690b4e02bb28 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:21.070481 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fed8e424-8ccc-4e6f-a3b1-690b4e02bb28 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:21.071197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fed8e424-8ccc-4e6f-a3b1-690b4e02bb28 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:21.071654 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fed8e424-8ccc-4e6f-a3b1-690b4e02bb28 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:21.072074 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fed8e424-8ccc-4e6f-a3b1-690b4e02bb28 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:21.096053 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=100 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:13:21.223406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-fed8e424-8ccc-4e6f-a3b1-690b4e02bb28 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:21.232912 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-fed8e424-8ccc-4e6f-a3b1-690b4e02bb28 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:21.234454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-fed8e424-8ccc-4e6f-a3b1-690b4e02bb28 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:21.235633 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-fed8e424-8ccc-4e6f-a3b1-690b4e02bb28 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.178867 Aug 19 21:13:21.236384 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 292/531] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:21 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:13:21.692943 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-914716f8-9b6a-481a-b525-1c8a44bf5e80 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:21.693636 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-914716f8-9b6a-481a-b525-1c8a44bf5e80 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:21.699969 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-914716f8-9b6a-481a-b525-1c8a44bf5e80 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:21.700445 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-914716f8-9b6a-481a-b525-1c8a44bf5e80 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:21.700877 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-914716f8-9b6a-481a-b525-1c8a44bf5e80 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:21.701572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-914716f8-9b6a-481a-b525-1c8a44bf5e80 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:21.702047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-914716f8-9b6a-481a-b525-1c8a44bf5e80 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:21.702467 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-914716f8-9b6a-481a-b525-1c8a44bf5e80 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:21.754149 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:13:21.852217 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=30 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:13:21.861472 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-914716f8-9b6a-481a-b525-1c8a44bf5e80 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:21.869366 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-914716f8-9b6a-481a-b525-1c8a44bf5e80 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.180802 Aug 19 21:13:21.869967 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 293/532] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:21 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:13:22.260191 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ea25b802-0ceb-490e-830c-77352365c5a5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:22.260790 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ea25b802-0ceb-490e-830c-77352365c5a5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:22.267048 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea25b802-0ceb-490e-830c-77352365c5a5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:22.267529 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea25b802-0ceb-490e-830c-77352365c5a5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:22.267952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea25b802-0ceb-490e-830c-77352365c5a5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:22.269940 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea25b802-0ceb-490e-830c-77352365c5a5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:22.270663 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea25b802-0ceb-490e-830c-77352365c5a5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:22.270793 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea25b802-0ceb-490e-830c-77352365c5a5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:22.414395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ea25b802-0ceb-490e-830c-77352365c5a5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:22.425492 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ea25b802-0ceb-490e-830c-77352365c5a5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:22.427094 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ea25b802-0ceb-490e-830c-77352365c5a5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:22.428266 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ea25b802-0ceb-490e-830c-77352365c5a5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.172031 Aug 19 21:13:22.429023 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 294/533] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:22 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:13:22.889522 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-31a7ce9d-4152-400d-b2be-fc408c8682cb tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:22.890284 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-31a7ce9d-4152-400d-b2be-fc408c8682cb tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:22.896531 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-31a7ce9d-4152-400d-b2be-fc408c8682cb tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:22.897012 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-31a7ce9d-4152-400d-b2be-fc408c8682cb tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:22.897442 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-31a7ce9d-4152-400d-b2be-fc408c8682cb tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:22.898165 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-31a7ce9d-4152-400d-b2be-fc408c8682cb tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:22.898619 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-31a7ce9d-4152-400d-b2be-fc408c8682cb tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:22.899047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-31a7ce9d-4152-400d-b2be-fc408c8682cb tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:23.035006 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-31a7ce9d-4152-400d-b2be-fc408c8682cb tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:23.042715 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-31a7ce9d-4152-400d-b2be-fc408c8682cb tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.157003 Aug 19 21:13:23.043283 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 295/534] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:22 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:13:23.452174 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-6b0ef109-28b7-42c6-97eb-a095ef092ca1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:23.452809 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-6b0ef109-28b7-42c6-97eb-a095ef092ca1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:23.460414 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6b0ef109-28b7-42c6-97eb-a095ef092ca1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:23.460995 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6b0ef109-28b7-42c6-97eb-a095ef092ca1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:23.461316 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6b0ef109-28b7-42c6-97eb-a095ef092ca1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:23.462044 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6b0ef109-28b7-42c6-97eb-a095ef092ca1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:23.462498 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6b0ef109-28b7-42c6-97eb-a095ef092ca1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:23.462911 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6b0ef109-28b7-42c6-97eb-a095ef092ca1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:23.631126 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-6b0ef109-28b7-42c6-97eb-a095ef092ca1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:23.639859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-6b0ef109-28b7-42c6-97eb-a095ef092ca1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:23.641363 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-6b0ef109-28b7-42c6-97eb-a095ef092ca1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:23.642535 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-6b0ef109-28b7-42c6-97eb-a095ef092ca1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.194326 Aug 19 21:13:23.643089 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 296/535] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:23 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:13:24.063452 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-135590ab-7dfd-4b4d-90bc-2bd4f27e1615 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:24.064132 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-135590ab-7dfd-4b4d-90bc-2bd4f27e1615 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:24.070841 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-135590ab-7dfd-4b4d-90bc-2bd4f27e1615 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:24.071323 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-135590ab-7dfd-4b4d-90bc-2bd4f27e1615 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:24.071752 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-135590ab-7dfd-4b4d-90bc-2bd4f27e1615 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:24.072445 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-135590ab-7dfd-4b4d-90bc-2bd4f27e1615 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:24.072891 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-135590ab-7dfd-4b4d-90bc-2bd4f27e1615 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:24.073308 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-135590ab-7dfd-4b4d-90bc-2bd4f27e1615 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:24.211406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-135590ab-7dfd-4b4d-90bc-2bd4f27e1615 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:24.223674 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-135590ab-7dfd-4b4d-90bc-2bd4f27e1615 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.163908 Aug 19 21:13:24.224469 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 297/536] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:24 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:13:24.666109 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3461fdde-6e9e-41fe-8173-7c44908dd09c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:24.666724 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-3461fdde-6e9e-41fe-8173-7c44908dd09c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:24.672978 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3461fdde-6e9e-41fe-8173-7c44908dd09c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:24.673462 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3461fdde-6e9e-41fe-8173-7c44908dd09c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:24.673929 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3461fdde-6e9e-41fe-8173-7c44908dd09c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:24.674629 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3461fdde-6e9e-41fe-8173-7c44908dd09c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:24.675084 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3461fdde-6e9e-41fe-8173-7c44908dd09c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:24.675585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3461fdde-6e9e-41fe-8173-7c44908dd09c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:24.812579 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3461fdde-6e9e-41fe-8173-7c44908dd09c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:24.822117 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3461fdde-6e9e-41fe-8173-7c44908dd09c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:24.823638 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3461fdde-6e9e-41fe-8173-7c44908dd09c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:24.824793 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-3461fdde-6e9e-41fe-8173-7c44908dd09c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.162694 Aug 19 21:13:24.825404 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 298/537] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:24 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:13:25.244578 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-113c2ee4-c65c-483f-af41-5ce3b15a17e4 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:25.245246 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-113c2ee4-c65c-483f-af41-5ce3b15a17e4 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:25.251642 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-113c2ee4-c65c-483f-af41-5ce3b15a17e4 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:25.252131 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-113c2ee4-c65c-483f-af41-5ce3b15a17e4 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:25.252571 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-113c2ee4-c65c-483f-af41-5ce3b15a17e4 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:25.253279 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-113c2ee4-c65c-483f-af41-5ce3b15a17e4 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:25.254565 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-113c2ee4-c65c-483f-af41-5ce3b15a17e4 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:25.255813 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-113c2ee4-c65c-483f-af41-5ce3b15a17e4 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:25.389334 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-113c2ee4-c65c-483f-af41-5ce3b15a17e4 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:25.398263 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-113c2ee4-c65c-483f-af41-5ce3b15a17e4 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.157398 Aug 19 21:13:25.398845 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 299/538] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:25 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:13:25.849227 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-11455ff0-8e57-4e1a-9cbf-75c25968344b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:25.849868 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-11455ff0-8e57-4e1a-9cbf-75c25968344b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:25.855894 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-11455ff0-8e57-4e1a-9cbf-75c25968344b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:25.856375 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-11455ff0-8e57-4e1a-9cbf-75c25968344b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:25.856811 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-11455ff0-8e57-4e1a-9cbf-75c25968344b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:25.857522 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-11455ff0-8e57-4e1a-9cbf-75c25968344b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:25.858015 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-11455ff0-8e57-4e1a-9cbf-75c25968344b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:25.858436 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-11455ff0-8e57-4e1a-9cbf-75c25968344b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:25.993235 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-11455ff0-8e57-4e1a-9cbf-75c25968344b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:26.001889 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-11455ff0-8e57-4e1a-9cbf-75c25968344b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:26.003398 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-11455ff0-8e57-4e1a-9cbf-75c25968344b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:26.004557 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-11455ff0-8e57-4e1a-9cbf-75c25968344b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.159993 Aug 19 21:13:26.005373 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 300/539] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:25 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:13:26.419762 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0eb8a040-f741-47af-b6fb-7a5d21d86977 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:26.420390 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0eb8a040-f741-47af-b6fb-7a5d21d86977 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:26.426755 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0eb8a040-f741-47af-b6fb-7a5d21d86977 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:26.427240 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0eb8a040-f741-47af-b6fb-7a5d21d86977 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:26.427669 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0eb8a040-f741-47af-b6fb-7a5d21d86977 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:26.428352 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0eb8a040-f741-47af-b6fb-7a5d21d86977 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:26.428796 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0eb8a040-f741-47af-b6fb-7a5d21d86977 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:26.429207 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0eb8a040-f741-47af-b6fb-7a5d21d86977 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:26.558415 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0eb8a040-f741-47af-b6fb-7a5d21d86977 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:26.566606 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0eb8a040-f741-47af-b6fb-7a5d21d86977 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.150745 Aug 19 21:13:26.567290 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 301/540] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:26 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:13:27.027549 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-f3a9c41a-2928-4416-b04d-7addc8102369 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:27.028152 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-f3a9c41a-2928-4416-b04d-7addc8102369 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:27.034189 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f3a9c41a-2928-4416-b04d-7addc8102369 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:27.034665 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f3a9c41a-2928-4416-b04d-7addc8102369 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:27.035143 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f3a9c41a-2928-4416-b04d-7addc8102369 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:27.036106 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f3a9c41a-2928-4416-b04d-7addc8102369 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:27.036554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f3a9c41a-2928-4416-b04d-7addc8102369 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:27.037014 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f3a9c41a-2928-4416-b04d-7addc8102369 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:27.169758 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-f3a9c41a-2928-4416-b04d-7addc8102369 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:27.179379 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-f3a9c41a-2928-4416-b04d-7addc8102369 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:27.180877 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-f3a9c41a-2928-4416-b04d-7addc8102369 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:27.182094 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-f3a9c41a-2928-4416-b04d-7addc8102369 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.158390 Aug 19 21:13:27.183244 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 302/541] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:27 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:13:27.587429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-266b1b9a-3544-4200-98d1-e190a4f47cb3 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:27.588112 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-266b1b9a-3544-4200-98d1-e190a4f47cb3 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:27.594467 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-266b1b9a-3544-4200-98d1-e190a4f47cb3 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:27.594938 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-266b1b9a-3544-4200-98d1-e190a4f47cb3 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:27.595361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-266b1b9a-3544-4200-98d1-e190a4f47cb3 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:27.596036 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-266b1b9a-3544-4200-98d1-e190a4f47cb3 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:27.596483 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-266b1b9a-3544-4200-98d1-e190a4f47cb3 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:27.596894 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-266b1b9a-3544-4200-98d1-e190a4f47cb3 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:27.733889 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-266b1b9a-3544-4200-98d1-e190a4f47cb3 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:27.741860 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-266b1b9a-3544-4200-98d1-e190a4f47cb3 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.158265 Aug 19 21:13:27.742386 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 303/542] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:27 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:28.206254 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-622a32ad-d92c-495f-a480-ba6d3dec2bd1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:28.207505 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-622a32ad-d92c-495f-a480-ba6d3dec2bd1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:28.213643 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-622a32ad-d92c-495f-a480-ba6d3dec2bd1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:28.214165 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-622a32ad-d92c-495f-a480-ba6d3dec2bd1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:28.214610 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-622a32ad-d92c-495f-a480-ba6d3dec2bd1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:28.215300 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-622a32ad-d92c-495f-a480-ba6d3dec2bd1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:28.215750 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-622a32ad-d92c-495f-a480-ba6d3dec2bd1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:28.216175 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-622a32ad-d92c-495f-a480-ba6d3dec2bd1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:28.347599 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-622a32ad-d92c-495f-a480-ba6d3dec2bd1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:28.356286 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-622a32ad-d92c-495f-a480-ba6d3dec2bd1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:28.357808 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-622a32ad-d92c-495f-a480-ba6d3dec2bd1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:28.358961 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-622a32ad-d92c-495f-a480-ba6d3dec2bd1 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.156953 Aug 19 21:13:28.359523 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 304/543] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:28 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:13:28.763072 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8279bbce-7dc5-4432-9339-e36383b23051 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:28.763734 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8279bbce-7dc5-4432-9339-e36383b23051 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:28.770672 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8279bbce-7dc5-4432-9339-e36383b23051 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:28.771146 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8279bbce-7dc5-4432-9339-e36383b23051 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:28.771575 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8279bbce-7dc5-4432-9339-e36383b23051 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:28.772256 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8279bbce-7dc5-4432-9339-e36383b23051 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:28.772704 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8279bbce-7dc5-4432-9339-e36383b23051 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:28.773120 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8279bbce-7dc5-4432-9339-e36383b23051 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:28.906421 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8279bbce-7dc5-4432-9339-e36383b23051 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:28.914128 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8279bbce-7dc5-4432-9339-e36383b23051 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.154922 Aug 19 21:13:28.914692 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 305/544] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:28 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:13:29.383736 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-b6fd8a2a-728f-4d43-94b0-abfae47ea788 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:29.384254 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-b6fd8a2a-728f-4d43-94b0-abfae47ea788 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:29.390295 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b6fd8a2a-728f-4d43-94b0-abfae47ea788 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:29.390780 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b6fd8a2a-728f-4d43-94b0-abfae47ea788 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:29.391207 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b6fd8a2a-728f-4d43-94b0-abfae47ea788 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:29.391896 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b6fd8a2a-728f-4d43-94b0-abfae47ea788 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:29.392349 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b6fd8a2a-728f-4d43-94b0-abfae47ea788 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:29.392769 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b6fd8a2a-728f-4d43-94b0-abfae47ea788 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:29.526071 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-b6fd8a2a-728f-4d43-94b0-abfae47ea788 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:29.536069 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-b6fd8a2a-728f-4d43-94b0-abfae47ea788 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:29.537646 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-b6fd8a2a-728f-4d43-94b0-abfae47ea788 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:29.538847 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-b6fd8a2a-728f-4d43-94b0-abfae47ea788 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.160414 Aug 19 21:13:29.539405 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 306/545] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:29 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:13:29.935532 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-675a3705-92ee-4f11-bcce-064f0b61fdbe tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:29.936159 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-675a3705-92ee-4f11-bcce-064f0b61fdbe tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:29.942987 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-675a3705-92ee-4f11-bcce-064f0b61fdbe tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:29.943472 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-675a3705-92ee-4f11-bcce-064f0b61fdbe tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:29.943912 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-675a3705-92ee-4f11-bcce-064f0b61fdbe tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:29.944617 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-675a3705-92ee-4f11-bcce-064f0b61fdbe tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:29.945071 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-675a3705-92ee-4f11-bcce-064f0b61fdbe tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:29.945495 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-675a3705-92ee-4f11-bcce-064f0b61fdbe tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:29.961536 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-cdac3b07-ad41-46f1-b7a7-6021dd176b11 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "POST /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 18.219266 Aug 19 21:13:29.962283 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 240/546] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Aug 19 21:13:11 2022] POST /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539/os-volume_attachments => generated 194 bytes in 18221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:13:30.084130 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-675a3705-92ee-4f11-bcce-064f0b61fdbe tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:30.091903 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-675a3705-92ee-4f11-bcce-064f0b61fdbe tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.160326 Aug 19 21:13:30.092468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 307/547] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:29 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:13:30.563261 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-6f747eab-2dcf-4f75-b80c-11edd3dc69b5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:30.563918 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-6f747eab-2dcf-4f75-b80c-11edd3dc69b5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:30.571898 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6f747eab-2dcf-4f75-b80c-11edd3dc69b5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:30.572376 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6f747eab-2dcf-4f75-b80c-11edd3dc69b5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:30.572801 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6f747eab-2dcf-4f75-b80c-11edd3dc69b5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:30.573474 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6f747eab-2dcf-4f75-b80c-11edd3dc69b5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:30.573960 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6f747eab-2dcf-4f75-b80c-11edd3dc69b5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:30.574373 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6f747eab-2dcf-4f75-b80c-11edd3dc69b5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:30.716874 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-6f747eab-2dcf-4f75-b80c-11edd3dc69b5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:30.726682 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-6f747eab-2dcf-4f75-b80c-11edd3dc69b5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:30.728191 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-6f747eab-2dcf-4f75-b80c-11edd3dc69b5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:30.729355 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-6f747eab-2dcf-4f75-b80c-11edd3dc69b5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.170830 Aug 19 21:13:30.729948 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 241/548] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:30 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:13:31.113756 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-fea48146-f845-40a8-8a2d-6a3a434528e3 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:31.114530 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-fea48146-f845-40a8-8a2d-6a3a434528e3 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:31.121021 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fea48146-f845-40a8-8a2d-6a3a434528e3 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:31.121510 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fea48146-f845-40a8-8a2d-6a3a434528e3 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:31.121985 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fea48146-f845-40a8-8a2d-6a3a434528e3 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:31.122693 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fea48146-f845-40a8-8a2d-6a3a434528e3 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:31.123149 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fea48146-f845-40a8-8a2d-6a3a434528e3 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:31.123574 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fea48146-f845-40a8-8a2d-6a3a434528e3 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:31.327110 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-fea48146-f845-40a8-8a2d-6a3a434528e3 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:31.329432 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=100 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:13:31.336964 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-fea48146-f845-40a8-8a2d-6a3a434528e3 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1315 microversion: 2.1 time: 0.228297 Aug 19 21:13:31.337623 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 308/549] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:31 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:31.755902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-17b55d95-af61-46bf-bd4c-c01e50501e08 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:31.756511 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-17b55d95-af61-46bf-bd4c-c01e50501e08 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:31.762701 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-17b55d95-af61-46bf-bd4c-c01e50501e08 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:31.763182 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-17b55d95-af61-46bf-bd4c-c01e50501e08 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:31.763617 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-17b55d95-af61-46bf-bd4c-c01e50501e08 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:31.764318 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-17b55d95-af61-46bf-bd4c-c01e50501e08 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:31.764929 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-17b55d95-af61-46bf-bd4c-c01e50501e08 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:31.765959 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-17b55d95-af61-46bf-bd4c-c01e50501e08 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:31.902581 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-17b55d95-af61-46bf-bd4c-c01e50501e08 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:31.911935 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-17b55d95-af61-46bf-bd4c-c01e50501e08 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:31.913472 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-17b55d95-af61-46bf-bd4c-c01e50501e08 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:31.914749 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-17b55d95-af61-46bf-bd4c-c01e50501e08 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.166436 Aug 19 21:13:31.915309 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 242/550] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:31 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:13:32.358487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-556ab74f-ccac-493c-ba1a-df6b903f53bd tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:32.359036 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-556ab74f-ccac-493c-ba1a-df6b903f53bd tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:32.366197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-556ab74f-ccac-493c-ba1a-df6b903f53bd tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:32.366683 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-556ab74f-ccac-493c-ba1a-df6b903f53bd tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:32.367121 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-556ab74f-ccac-493c-ba1a-df6b903f53bd tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:32.367811 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-556ab74f-ccac-493c-ba1a-df6b903f53bd tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:32.368265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-556ab74f-ccac-493c-ba1a-df6b903f53bd tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:32.368687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-556ab74f-ccac-493c-ba1a-df6b903f53bd tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:32.500556 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-556ab74f-ccac-493c-ba1a-df6b903f53bd tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:32.509334 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-556ab74f-ccac-493c-ba1a-df6b903f53bd tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1464 microversion: 2.1 time: 0.155157 Aug 19 21:13:32.509963 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 309/551] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:32 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1464 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:32.556041 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-71e3f6ec-9f93-4aeb-aabc-b8a36d798339 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:32.556524 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-71e3f6ec-9f93-4aeb-aabc-b8a36d798339 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:32.562910 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71e3f6ec-9f93-4aeb-aabc-b8a36d798339 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:32.563384 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71e3f6ec-9f93-4aeb-aabc-b8a36d798339 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:32.563811 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71e3f6ec-9f93-4aeb-aabc-b8a36d798339 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:32.564485 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71e3f6ec-9f93-4aeb-aabc-b8a36d798339 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:32.564930 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71e3f6ec-9f93-4aeb-aabc-b8a36d798339 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:32.565341 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71e3f6ec-9f93-4aeb-aabc-b8a36d798339 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:32.591343 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-71e3f6ec-9f93-4aeb-aabc-b8a36d798339 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Going to try to terminate instance {{(pid=120876) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 21:13:32.672340 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-71e3f6ec-9f93-4aeb-aabc-b8a36d798339 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "DELETE /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 204 len: 0 microversion: 2.1 time: 0.119731 Aug 19 21:13:32.673317 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 243/552] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:13:32 2022] DELETE /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 21:13:32.683517 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-61677de0-25be-4a28-b0f7-4aa6b0a25358 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:32.684378 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-61677de0-25be-4a28-b0f7-4aa6b0a25358 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:32.690309 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-61677de0-25be-4a28-b0f7-4aa6b0a25358 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:32.690785 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-61677de0-25be-4a28-b0f7-4aa6b0a25358 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:32.691443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-61677de0-25be-4a28-b0f7-4aa6b0a25358 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:32.692094 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-61677de0-25be-4a28-b0f7-4aa6b0a25358 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:32.692545 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-61677de0-25be-4a28-b0f7-4aa6b0a25358 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:32.692959 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-61677de0-25be-4a28-b0f7-4aa6b0a25358 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:32.825471 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-61677de0-25be-4a28-b0f7-4aa6b0a25358 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:32.833406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-61677de0-25be-4a28-b0f7-4aa6b0a25358 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1470 microversion: 2.1 time: 0.154065 Aug 19 21:13:32.834002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 310/553] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:32 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:32.939567 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-803a4f5f-37ff-4c55-a895-f8a30ea3ea27 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:32.940176 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-803a4f5f-37ff-4c55-a895-f8a30ea3ea27 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:32.946253 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-803a4f5f-37ff-4c55-a895-f8a30ea3ea27 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:32.946710 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-803a4f5f-37ff-4c55-a895-f8a30ea3ea27 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:32.947136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-803a4f5f-37ff-4c55-a895-f8a30ea3ea27 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:32.947811 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-803a4f5f-37ff-4c55-a895-f8a30ea3ea27 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:32.948258 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-803a4f5f-37ff-4c55-a895-f8a30ea3ea27 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:32.948668 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-803a4f5f-37ff-4c55-a895-f8a30ea3ea27 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:33.084466 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-803a4f5f-37ff-4c55-a895-f8a30ea3ea27 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:33.093346 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-803a4f5f-37ff-4c55-a895-f8a30ea3ea27 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:33.095057 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-803a4f5f-37ff-4c55-a895-f8a30ea3ea27 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:33.096077 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-803a4f5f-37ff-4c55-a895-f8a30ea3ea27 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.160922 Aug 19 21:13:33.096647 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 244/554] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:32 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:13:33.854077 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-bf936ff8-ca09-4d14-bf58-1cc2a18628e0 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:33.854679 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-bf936ff8-ca09-4d14-bf58-1cc2a18628e0 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:33.861094 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bf936ff8-ca09-4d14-bf58-1cc2a18628e0 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:33.861574 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bf936ff8-ca09-4d14-bf58-1cc2a18628e0 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:33.862037 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bf936ff8-ca09-4d14-bf58-1cc2a18628e0 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:33.862767 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bf936ff8-ca09-4d14-bf58-1cc2a18628e0 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:33.863341 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bf936ff8-ca09-4d14-bf58-1cc2a18628e0 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:33.863762 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bf936ff8-ca09-4d14-bf58-1cc2a18628e0 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:34.002842 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-bf936ff8-ca09-4d14-bf58-1cc2a18628e0 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:34.011319 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-bf936ff8-ca09-4d14-bf58-1cc2a18628e0 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1470 microversion: 2.1 time: 0.161065 Aug 19 21:13:34.011892 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 311/555] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:33 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:34.120044 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-b492d178-0d4f-4c0e-8a05-dbb4b22deb6a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:34.120651 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-b492d178-0d4f-4c0e-8a05-dbb4b22deb6a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:34.127145 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b492d178-0d4f-4c0e-8a05-dbb4b22deb6a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:34.127630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b492d178-0d4f-4c0e-8a05-dbb4b22deb6a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:34.128063 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b492d178-0d4f-4c0e-8a05-dbb4b22deb6a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:34.128798 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b492d178-0d4f-4c0e-8a05-dbb4b22deb6a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:34.129350 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b492d178-0d4f-4c0e-8a05-dbb4b22deb6a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:34.129788 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b492d178-0d4f-4c0e-8a05-dbb4b22deb6a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:34.260116 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b492d178-0d4f-4c0e-8a05-dbb4b22deb6a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:34.269746 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b492d178-0d4f-4c0e-8a05-dbb4b22deb6a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:34.271108 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b492d178-0d4f-4c0e-8a05-dbb4b22deb6a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:34.272261 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-b492d178-0d4f-4c0e-8a05-dbb4b22deb6a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.156246 Aug 19 21:13:34.272817 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 245/556] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:34 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:13:35.032846 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-52e74f7a-4a15-454d-9eab-7eaa2ea7e2c5 req-a2974881-0995-43ac-a57c-27aa978d0691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26ca6bb6-a021-425d-8615-2a75cd09a479", "name": "network-vif-deleted", "tag": "35ce9460-2752-4e73-a438-9f45f0d7b3d0"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:13:35.034997 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-935234ae-cc8d-4b14-8bf3-59d049248762 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:35.035612 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-935234ae-cc8d-4b14-8bf3-59d049248762 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:35.041991 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-935234ae-cc8d-4b14-8bf3-59d049248762 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:35.042486 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-935234ae-cc8d-4b14-8bf3-59d049248762 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:35.043109 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-935234ae-cc8d-4b14-8bf3-59d049248762 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:35.043631 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-935234ae-cc8d-4b14-8bf3-59d049248762 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:35.044086 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-935234ae-cc8d-4b14-8bf3-59d049248762 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:35.044504 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-935234ae-cc8d-4b14-8bf3-59d049248762 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:35.045634 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-52e74f7a-4a15-454d-9eab-7eaa2ea7e2c5 req-a2974881-0995-43ac-a57c-27aa978d0691 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:35.046143 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-52e74f7a-4a15-454d-9eab-7eaa2ea7e2c5 req-a2974881-0995-43ac-a57c-27aa978d0691 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:35.046582 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-52e74f7a-4a15-454d-9eab-7eaa2ea7e2c5 req-a2974881-0995-43ac-a57c-27aa978d0691 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:35.058399 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-52e74f7a-4a15-454d-9eab-7eaa2ea7e2c5 req-a2974881-0995-43ac-a57c-27aa978d0691 service nova] Creating event network-vif-deleted:35ce9460-2752-4e73-a438-9f45f0d7b3d0 for instance 26ca6bb6-a021-425d-8615-2a75cd09a479 on hv-cinder-85220 Aug 19 21:13:35.063869 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-52e74f7a-4a15-454d-9eab-7eaa2ea7e2c5 req-a2974881-0995-43ac-a57c-27aa978d0691 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039267 Aug 19 21:13:35.064562 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 312/557] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:13:35.111864 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-935234ae-cc8d-4b14-8bf3-59d049248762 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:35.120170 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-935234ae-cc8d-4b14-8bf3-59d049248762 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1428 microversion: 2.1 time: 0.088988 Aug 19 21:13:35.121877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 246/558] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:35 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1428 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:13:35.295890 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c531aa84-a2dc-47bf-b4a6-2accf1421a02 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:35.296618 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-c531aa84-a2dc-47bf-b4a6-2accf1421a02 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:35.303516 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c531aa84-a2dc-47bf-b4a6-2accf1421a02 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:35.304001 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c531aa84-a2dc-47bf-b4a6-2accf1421a02 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:35.304434 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c531aa84-a2dc-47bf-b4a6-2accf1421a02 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:35.305124 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c531aa84-a2dc-47bf-b4a6-2accf1421a02 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:35.305578 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c531aa84-a2dc-47bf-b4a6-2accf1421a02 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:35.306028 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c531aa84-a2dc-47bf-b4a6-2accf1421a02 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:35.435219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c531aa84-a2dc-47bf-b4a6-2accf1421a02 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:35.444567 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c531aa84-a2dc-47bf-b4a6-2accf1421a02 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:35.446114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c531aa84-a2dc-47bf-b4a6-2accf1421a02 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:35.447275 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-c531aa84-a2dc-47bf-b4a6-2accf1421a02 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.155643 Aug 19 21:13:35.447830 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 313/559] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:35 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:13:36.142326 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-165cf740-9c56-4352-ac8c-8c1cd8ad4b0a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:36.142930 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-165cf740-9c56-4352-ac8c-8c1cd8ad4b0a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:36.150359 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-165cf740-9c56-4352-ac8c-8c1cd8ad4b0a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:36.150868 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-165cf740-9c56-4352-ac8c-8c1cd8ad4b0a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:36.151374 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-165cf740-9c56-4352-ac8c-8c1cd8ad4b0a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:36.152214 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-165cf740-9c56-4352-ac8c-8c1cd8ad4b0a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:36.152743 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-165cf740-9c56-4352-ac8c-8c1cd8ad4b0a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:36.153240 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-165cf740-9c56-4352-ac8c-8c1cd8ad4b0a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:36.219053 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-165cf740-9c56-4352-ac8c-8c1cd8ad4b0a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:36.227419 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-165cf740-9c56-4352-ac8c-8c1cd8ad4b0a tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1428 microversion: 2.1 time: 0.088937 Aug 19 21:13:36.227977 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 247/560] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:36 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1428 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:36.470935 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a3212eac-ccdf-40a7-8f8d-b364ecd7a44a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:36.471575 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-a3212eac-ccdf-40a7-8f8d-b364ecd7a44a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:36.478447 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3212eac-ccdf-40a7-8f8d-b364ecd7a44a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:36.478929 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3212eac-ccdf-40a7-8f8d-b364ecd7a44a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:36.479360 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3212eac-ccdf-40a7-8f8d-b364ecd7a44a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:36.480044 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3212eac-ccdf-40a7-8f8d-b364ecd7a44a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:36.480495 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3212eac-ccdf-40a7-8f8d-b364ecd7a44a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:36.480916 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3212eac-ccdf-40a7-8f8d-b364ecd7a44a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:36.612474 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-a3212eac-ccdf-40a7-8f8d-b364ecd7a44a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:36.621217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-a3212eac-ccdf-40a7-8f8d-b364ecd7a44a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:36.622757 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-a3212eac-ccdf-40a7-8f8d-b364ecd7a44a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:36.623907 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-a3212eac-ccdf-40a7-8f8d-b364ecd7a44a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.157525 Aug 19 21:13:36.624456 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 314/561] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:36 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:13:37.247959 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-e463c8de-0b66-49a7-9f6f-546e79ea7a9c tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:37.248566 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-e463c8de-0b66-49a7-9f6f-546e79ea7a9c tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:37.254972 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e463c8de-0b66-49a7-9f6f-546e79ea7a9c tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:37.255456 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e463c8de-0b66-49a7-9f6f-546e79ea7a9c tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:37.255891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e463c8de-0b66-49a7-9f6f-546e79ea7a9c tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:37.257073 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e463c8de-0b66-49a7-9f6f-546e79ea7a9c tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:37.257598 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e463c8de-0b66-49a7-9f6f-546e79ea7a9c tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:37.258125 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e463c8de-0b66-49a7-9f6f-546e79ea7a9c tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:37.324609 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-e463c8de-0b66-49a7-9f6f-546e79ea7a9c tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526a58b0c4f49739545419d1fa1feca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f34422d436a4dbeb7102d599f7996d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:37.333115 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-e463c8de-0b66-49a7-9f6f-546e79ea7a9c tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 200 len: 1300 microversion: 2.1 time: 0.088930 Aug 19 21:13:37.333613 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 248/562] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:37 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:37.648788 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-fc19b5a8-f2e3-42f8-addb-867fa5ba1d9e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:37.649350 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-fc19b5a8-f2e3-42f8-addb-867fa5ba1d9e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:37.656096 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fc19b5a8-f2e3-42f8-addb-867fa5ba1d9e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:37.656585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fc19b5a8-f2e3-42f8-addb-867fa5ba1d9e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:37.657023 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fc19b5a8-f2e3-42f8-addb-867fa5ba1d9e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:37.657724 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fc19b5a8-f2e3-42f8-addb-867fa5ba1d9e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:37.658233 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fc19b5a8-f2e3-42f8-addb-867fa5ba1d9e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:37.658689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fc19b5a8-f2e3-42f8-addb-867fa5ba1d9e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:37.795491 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-fc19b5a8-f2e3-42f8-addb-867fa5ba1d9e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:37.804997 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-fc19b5a8-f2e3-42f8-addb-867fa5ba1d9e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:37.806538 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-fc19b5a8-f2e3-42f8-addb-867fa5ba1d9e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:37.807690 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-fc19b5a8-f2e3-42f8-addb-867fa5ba1d9e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.164331 Aug 19 21:13:37.808246 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 315/563] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:37 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:13:38.354732 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-46cbdc0a-509c-4a45-ad69-218d78ab4c40 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:38.355272 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-46cbdc0a-509c-4a45-ad69-218d78ab4c40 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] [instance: 26ca6bb6-a021-425d-8615-2a75cd09a479] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:38.361648 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-46cbdc0a-509c-4a45-ad69-218d78ab4c40 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:38.362167 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-46cbdc0a-509c-4a45-ad69-218d78ab4c40 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:38.362599 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-46cbdc0a-509c-4a45-ad69-218d78ab4c40 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:38.363285 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-46cbdc0a-509c-4a45-ad69-218d78ab4c40 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:38.363737 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-46cbdc0a-509c-4a45-ad69-218d78ab4c40 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:38.364157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-46cbdc0a-509c-4a45-ad69-218d78ab4c40 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:38.377592 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-46cbdc0a-509c-4a45-ad69-218d78ab4c40 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] HTTP exception thrown: Instance 26ca6bb6-a021-425d-8615-2a75cd09a479 could not be found. Aug 19 21:13:38.379264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-46cbdc0a-509c-4a45-ad69-218d78ab4c40 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Request method failure captured: Aug 19 21:13:38.379264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 HTTP/1.1 Aug 19 21:13:38.379264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:13:38.379264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:13:38.379264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:13:38.379264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:13:38.379264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:13:38.379264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:13:38.379264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:13:38.379264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:13:38.379264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__zWXV6WWkjbapuc7cv4z8Dot0d19-j_34MWYItes-EiMHsmJuhF1ABro2XWnK1EWsB9sXbs26FyrGtRePe5Gzh8HP9K_DKOz7RlpAcuB5EbyjAVtCQzf0jbYVXXkJpThKoQ28kNz7PzKZY-0Jl82J-FZDBgNN7b0Ahau4ohewfNWaQ Aug 19 21:13:38.379264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:13:38.379264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:13:38.379264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:13:38.379264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:13:38.379264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:13:38.379264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:13:38.379264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: 7f34422d436a4dbeb7102d599f7996d0 Aug 19 21:13:38.379264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-VolumesNegativeTest-719785653 Aug 19 21:13:38.379264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:13:38.379264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:13:38.380815 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7f34422d436a4dbeb7102d599f7996d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7f34422d436a4dbeb7102d599f7996d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7f34422d436a4dbeb7102d599f7996d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7f34422d436a4dbeb7102d599f7996d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:13:38.380815 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-VolumesNegativeTest-719785653 Aug 19 21:13:38.380815 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: 7f34422d436a4dbeb7102d599f7996d0 Aug 19 21:13:38.380815 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-VolumesNegativeTest-719785653 Aug 19 21:13:38.380815 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-VolumesNegativeTest-719785653-project Aug 19 21:13:38.380815 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:13:38.380815 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:13:38.380815 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: b526a58b0c4f49739545419d1fa1feca Aug 19 21:13:38.380815 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-VolumesNegativeTest-719785653-project Aug 19 21:13:38.380815 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: > Aug 19 21:13:38.380815 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Instance 26ca6bb6-a021-425d-8615-2a75cd09a479 could not be found. Aug 19 21:13:38.380815 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': '26ca6bb6-a021-425d-8615-2a75cd09a479'} Aug 19 21:13:38.381810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:13:38.381810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:13:38.381810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:13:38.381810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:13:38.381810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:13:38.381810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:13:38.381810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:13:38.381810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:13:38.381810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:13:38.381810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:13:38.381810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26ca6bb6-a021-425d-8615-2a75cd09a479 could not be found. Aug 19 21:13:38.381810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:13:38.381810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:13:38.381810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:13:38.381810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:13:38.381810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:13:38.381810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:13:38.381810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:13:38.381810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:13:38.381810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:13:38.383587 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:13:38.383587 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:13:38.383587 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:13:38.383587 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:13:38.383587 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:13:38.383587 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:13:38.383587 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:13:38.383587 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26ca6bb6-a021-425d-8615-2a75cd09a479 could not be found. Aug 19 21:13:38.383587 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:13:38.383587 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:13:38.383587 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:13:38.383587 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:13:38.383587 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:13:38.383587 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:13:38.383587 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:13:38.383587 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:13:38.383587 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26ca6bb6-a021-425d-8615-2a75cd09a479 could not be found. Aug 19 21:13:38.383587 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:13:38.385101 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-46cbdc0a-509c-4a45-ad69-218d78ab4c40 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] Returning 404 to user: Instance 26ca6bb6-a021-425d-8615-2a75cd09a479 could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:13:38.385101 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-46cbdc0a-509c-4a45-ad69-218d78ab4c40 tempest-VolumesNegativeTest-719785653 tempest-VolumesNegativeTest-719785653-project] 10.222.0.16 "GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479" status: 404 len: 111 microversion: 2.1 time: 0.030550 Aug 19 21:13:38.385101 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 249/564] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:38 2022] GET /compute/v2.1/servers/26ca6bb6-a021-425d-8615-2a75cd09a479 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:13:38.567629 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-41874a4e-1892-4e6c-8557-e3bbf1585170 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:13:38.571385 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-41874a4e-1892-4e6c-8557-e3bbf1585170 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:38.577548 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-41874a4e-1892-4e6c-8557-e3bbf1585170 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:38.578062 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-41874a4e-1892-4e6c-8557-e3bbf1585170 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:38.578496 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-41874a4e-1892-4e6c-8557-e3bbf1585170 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:38.579213 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-41874a4e-1892-4e6c-8557-e3bbf1585170 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:38.579665 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-41874a4e-1892-4e6c-8557-e3bbf1585170 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:38.580314 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-41874a4e-1892-4e6c-8557-e3bbf1585170 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:38.605568 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.objects.instance [None req-41874a4e-1892-4e6c-8557-e3bbf1585170 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lazy-loading 'flavor' on Instance uuid 7df3ead0-b255-4b0c-8fa7-f9ae80138539 {{(pid=120877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:13:38.747660 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-41874a4e-1892-4e6c-8557-e3bbf1585170 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "POST /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539/action" status: 200 len: 32 microversion: 2.1 time: 0.183918 Aug 19 21:13:38.748480 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 316/565] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Aug 19 21:13:38 2022] POST /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539/action => generated 32 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 21:13:38.758263 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-0b5d1886-6170-445b-aaa8-39ff49171258 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:38.758966 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-0b5d1886-6170-445b-aaa8-39ff49171258 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:38.765592 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0b5d1886-6170-445b-aaa8-39ff49171258 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:38.766119 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0b5d1886-6170-445b-aaa8-39ff49171258 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:38.766549 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0b5d1886-6170-445b-aaa8-39ff49171258 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:38.767449 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0b5d1886-6170-445b-aaa8-39ff49171258 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:38.767905 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0b5d1886-6170-445b-aaa8-39ff49171258 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:38.768337 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0b5d1886-6170-445b-aaa8-39ff49171258 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:38.833614 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8f30da07-644a-4417-91a7-371eb9e93d81 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:38.838667 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8f30da07-644a-4417-91a7-371eb9e93d81 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:38.845657 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8f30da07-644a-4417-91a7-371eb9e93d81 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:38.846490 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8f30da07-644a-4417-91a7-371eb9e93d81 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:38.847085 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8f30da07-644a-4417-91a7-371eb9e93d81 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:38.852085 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8f30da07-644a-4417-91a7-371eb9e93d81 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:38.853361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8f30da07-644a-4417-91a7-371eb9e93d81 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:38.854285 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8f30da07-644a-4417-91a7-371eb9e93d81 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:38.997227 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-0b5d1886-6170-445b-aaa8-39ff49171258 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:39.006025 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-0b5d1886-6170-445b-aaa8-39ff49171258 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1734 microversion: 2.1 time: 0.251892 Aug 19 21:13:39.006624 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 250/566] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:38 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1734 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:13:39.117564 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8f30da07-644a-4417-91a7-371eb9e93d81 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:39.133154 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8f30da07-644a-4417-91a7-371eb9e93d81 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:39.135009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8f30da07-644a-4417-91a7-371eb9e93d81 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:39.136547 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8f30da07-644a-4417-91a7-371eb9e93d81 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.308253 Aug 19 21:13:39.137261 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 317/567] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:38 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:13:40.028311 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-a230d3c0-5be0-4cd5-a601-7b10e64bbe06 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:40.028921 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-a230d3c0-5be0-4cd5-a601-7b10e64bbe06 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:40.035455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a230d3c0-5be0-4cd5-a601-7b10e64bbe06 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:40.035937 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a230d3c0-5be0-4cd5-a601-7b10e64bbe06 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:40.036368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a230d3c0-5be0-4cd5-a601-7b10e64bbe06 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:40.037074 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a230d3c0-5be0-4cd5-a601-7b10e64bbe06 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:40.037530 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a230d3c0-5be0-4cd5-a601-7b10e64bbe06 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:40.038519 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a230d3c0-5be0-4cd5-a601-7b10e64bbe06 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:40.161525 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-13e45b3f-3ebf-4c10-8979-5e2f047ca3b6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:40.162931 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-13e45b3f-3ebf-4c10-8979-5e2f047ca3b6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:40.165586 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=88 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:13:40.175775 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-13e45b3f-3ebf-4c10-8979-5e2f047ca3b6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:40.176271 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-13e45b3f-3ebf-4c10-8979-5e2f047ca3b6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:40.177269 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-13e45b3f-3ebf-4c10-8979-5e2f047ca3b6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:40.178216 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-13e45b3f-3ebf-4c10-8979-5e2f047ca3b6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:40.179055 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-13e45b3f-3ebf-4c10-8979-5e2f047ca3b6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:40.179955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-13e45b3f-3ebf-4c10-8979-5e2f047ca3b6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:40.184304 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-a230d3c0-5be0-4cd5-a601-7b10e64bbe06 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:40.198062 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-a230d3c0-5be0-4cd5-a601-7b10e64bbe06 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1734 microversion: 2.1 time: 0.173427 Aug 19 21:13:40.198709 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 251/568] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:40 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:40.323753 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-13e45b3f-3ebf-4c10-8979-5e2f047ca3b6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:40.332930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-13e45b3f-3ebf-4c10-8979-5e2f047ca3b6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:40.334494 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-13e45b3f-3ebf-4c10-8979-5e2f047ca3b6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:40.336545 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-13e45b3f-3ebf-4c10-8979-5e2f047ca3b6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.178597 Aug 19 21:13:40.337033 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 318/569] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:40 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:13:41.220074 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-22aab2fe-b385-4fb2-8180-bae7f657e8dc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:41.220727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-22aab2fe-b385-4fb2-8180-bae7f657e8dc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:41.228339 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-22aab2fe-b385-4fb2-8180-bae7f657e8dc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:41.228830 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-22aab2fe-b385-4fb2-8180-bae7f657e8dc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:41.229267 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-22aab2fe-b385-4fb2-8180-bae7f657e8dc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:41.230013 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-22aab2fe-b385-4fb2-8180-bae7f657e8dc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:41.230502 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-22aab2fe-b385-4fb2-8180-bae7f657e8dc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:41.230951 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-22aab2fe-b385-4fb2-8180-bae7f657e8dc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:41.274444 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-5bd489ea-cdc6-4de0-b401-592783a42f0b req-d0630e3f-93bc-4ddb-b314-9a542b4b02a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95c060a-e4cc-436c-a185-9345fd2c44f2", "name": "network-vif-plugged", "status": "completed", "tag": "c65527c3-278b-404c-9369-abd76c37a0b5"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:13:41.294223 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-5bd489ea-cdc6-4de0-b401-592783a42f0b req-d0630e3f-93bc-4ddb-b314-9a542b4b02a9 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:41.294759 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-5bd489ea-cdc6-4de0-b401-592783a42f0b req-d0630e3f-93bc-4ddb-b314-9a542b4b02a9 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:41.295186 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-5bd489ea-cdc6-4de0-b401-592783a42f0b req-d0630e3f-93bc-4ddb-b314-9a542b4b02a9 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:41.320164 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-5bd489ea-cdc6-4de0-b401-592783a42f0b req-d0630e3f-93bc-4ddb-b314-9a542b4b02a9 service nova] Creating event network-vif-plugged:c65527c3-278b-404c-9369-abd76c37a0b5 for instance f95c060a-e4cc-436c-a185-9345fd2c44f2 on hv-cinder-85220 Aug 19 21:13:41.327000 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-5bd489ea-cdc6-4de0-b401-592783a42f0b req-d0630e3f-93bc-4ddb-b314-9a542b4b02a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056222 Aug 19 21:13:41.328281 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 319/570] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:13:41.419657 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-22aab2fe-b385-4fb2-8180-bae7f657e8dc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:41.427930 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-22aab2fe-b385-4fb2-8180-bae7f657e8dc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1734 microversion: 2.1 time: 0.211699 Aug 19 21:13:41.429054 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 252/571] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:41 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1734 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:41.482585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-b58f8f8d-df29-4e7b-ad9d-92961002c521 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:41.483293 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-b58f8f8d-df29-4e7b-ad9d-92961002c521 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:41.489822 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b58f8f8d-df29-4e7b-ad9d-92961002c521 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:41.490310 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b58f8f8d-df29-4e7b-ad9d-92961002c521 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:41.490739 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b58f8f8d-df29-4e7b-ad9d-92961002c521 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:41.492636 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b58f8f8d-df29-4e7b-ad9d-92961002c521 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:41.493087 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b58f8f8d-df29-4e7b-ad9d-92961002c521 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:41.493507 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b58f8f8d-df29-4e7b-ad9d-92961002c521 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:41.629646 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-b58f8f8d-df29-4e7b-ad9d-92961002c521 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:41.639137 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-b58f8f8d-df29-4e7b-ad9d-92961002c521 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:41.640658 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-b58f8f8d-df29-4e7b-ad9d-92961002c521 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:41.641829 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-b58f8f8d-df29-4e7b-ad9d-92961002c521 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.286636 Aug 19 21:13:41.642378 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 320/572] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:41 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:13:42.450202 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-35e0b922-5034-4b3e-baa9-3e69d51a2f53 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:42.450875 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-35e0b922-5034-4b3e-baa9-3e69d51a2f53 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:42.457174 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-35e0b922-5034-4b3e-baa9-3e69d51a2f53 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:42.457675 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-35e0b922-5034-4b3e-baa9-3e69d51a2f53 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:42.459074 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-35e0b922-5034-4b3e-baa9-3e69d51a2f53 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:42.460073 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-35e0b922-5034-4b3e-baa9-3e69d51a2f53 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:42.460535 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-35e0b922-5034-4b3e-baa9-3e69d51a2f53 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:42.460983 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-35e0b922-5034-4b3e-baa9-3e69d51a2f53 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:42.619322 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-35e0b922-5034-4b3e-baa9-3e69d51a2f53 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:42.627816 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-35e0b922-5034-4b3e-baa9-3e69d51a2f53 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1734 microversion: 2.1 time: 0.181465 Aug 19 21:13:42.628393 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 253/573] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:42 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:42.665102 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-fe335f9b-67bb-4d02-9df8-2b01c50876de tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:42.665855 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-fe335f9b-67bb-4d02-9df8-2b01c50876de tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:42.672234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fe335f9b-67bb-4d02-9df8-2b01c50876de tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:42.672712 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fe335f9b-67bb-4d02-9df8-2b01c50876de tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:42.673142 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fe335f9b-67bb-4d02-9df8-2b01c50876de tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:42.674068 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fe335f9b-67bb-4d02-9df8-2b01c50876de tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:42.674310 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fe335f9b-67bb-4d02-9df8-2b01c50876de tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:42.674728 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fe335f9b-67bb-4d02-9df8-2b01c50876de tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:42.822114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-fe335f9b-67bb-4d02-9df8-2b01c50876de tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:42.831314 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-fe335f9b-67bb-4d02-9df8-2b01c50876de tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:42.832930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-fe335f9b-67bb-4d02-9df8-2b01c50876de tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:42.834214 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-fe335f9b-67bb-4d02-9df8-2b01c50876de tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.173653 Aug 19 21:13:42.835387 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 321/574] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:42 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:13:43.650891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-e4eaf05d-c6f2-470a-82ed-f42a72708562 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:43.651497 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-e4eaf05d-c6f2-470a-82ed-f42a72708562 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:43.657984 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e4eaf05d-c6f2-470a-82ed-f42a72708562 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:43.658467 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e4eaf05d-c6f2-470a-82ed-f42a72708562 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:43.659272 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e4eaf05d-c6f2-470a-82ed-f42a72708562 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:43.659958 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e4eaf05d-c6f2-470a-82ed-f42a72708562 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:43.660410 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e4eaf05d-c6f2-470a-82ed-f42a72708562 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:43.660833 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e4eaf05d-c6f2-470a-82ed-f42a72708562 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:43.793178 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-e4eaf05d-c6f2-470a-82ed-f42a72708562 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:43.801548 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-e4eaf05d-c6f2-470a-82ed-f42a72708562 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1734 microversion: 2.1 time: 0.155092 Aug 19 21:13:43.802150 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 254/575] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:43 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:43.857803 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-72666678-3d2d-40f0-8afb-2df7e1a7c1cb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:43.858535 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-72666678-3d2d-40f0-8afb-2df7e1a7c1cb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:43.864489 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-72666678-3d2d-40f0-8afb-2df7e1a7c1cb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:43.864981 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-72666678-3d2d-40f0-8afb-2df7e1a7c1cb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:43.865415 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-72666678-3d2d-40f0-8afb-2df7e1a7c1cb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:43.866225 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-72666678-3d2d-40f0-8afb-2df7e1a7c1cb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:43.866632 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-72666678-3d2d-40f0-8afb-2df7e1a7c1cb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:43.867442 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-72666678-3d2d-40f0-8afb-2df7e1a7c1cb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:44.002596 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-72666678-3d2d-40f0-8afb-2df7e1a7c1cb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:44.012518 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-72666678-3d2d-40f0-8afb-2df7e1a7c1cb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:44.014250 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-72666678-3d2d-40f0-8afb-2df7e1a7c1cb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:44.015513 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-72666678-3d2d-40f0-8afb-2df7e1a7c1cb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1807 microversion: 2.20 time: 0.161743 Aug 19 21:13:44.034135 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 322/576] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:43 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:13:44.823108 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-50ca7fd4-4ed1-4bd6-867b-66a60a33be09 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:44.823717 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-50ca7fd4-4ed1-4bd6-867b-66a60a33be09 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:44.830209 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-50ca7fd4-4ed1-4bd6-867b-66a60a33be09 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:44.830697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-50ca7fd4-4ed1-4bd6-867b-66a60a33be09 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:44.831131 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-50ca7fd4-4ed1-4bd6-867b-66a60a33be09 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:44.831821 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-50ca7fd4-4ed1-4bd6-867b-66a60a33be09 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:44.832275 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-50ca7fd4-4ed1-4bd6-867b-66a60a33be09 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:44.832699 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-50ca7fd4-4ed1-4bd6-867b-66a60a33be09 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:44.837527 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:13:44.966562 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-50ca7fd4-4ed1-4bd6-867b-66a60a33be09 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:44.974755 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-50ca7fd4-4ed1-4bd6-867b-66a60a33be09 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1734 microversion: 2.1 time: 0.155596 Aug 19 21:13:44.975998 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 255/577] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:44 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:45.042719 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-77a1e7d5-8fcb-4cc6-b28a-2ef9e02b1690 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:45.043571 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-77a1e7d5-8fcb-4cc6-b28a-2ef9e02b1690 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:45.050090 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-77a1e7d5-8fcb-4cc6-b28a-2ef9e02b1690 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:45.050569 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-77a1e7d5-8fcb-4cc6-b28a-2ef9e02b1690 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:45.051004 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-77a1e7d5-8fcb-4cc6-b28a-2ef9e02b1690 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:45.051684 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-77a1e7d5-8fcb-4cc6-b28a-2ef9e02b1690 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:45.052128 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-77a1e7d5-8fcb-4cc6-b28a-2ef9e02b1690 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:45.052543 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-77a1e7d5-8fcb-4cc6-b28a-2ef9e02b1690 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:45.182262 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-77a1e7d5-8fcb-4cc6-b28a-2ef9e02b1690 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:45.190972 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-77a1e7d5-8fcb-4cc6-b28a-2ef9e02b1690 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:45.192473 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-77a1e7d5-8fcb-4cc6-b28a-2ef9e02b1690 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:45.193619 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-77a1e7d5-8fcb-4cc6-b28a-2ef9e02b1690 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1794 microversion: 2.20 time: 0.155995 Aug 19 21:13:45.195346 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 323/578] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:13:45 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1794 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:13:45.997372 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-4886fe2e-2137-43cd-a399-3a606289f144 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:45.998359 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-4886fe2e-2137-43cd-a399-3a606289f144 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:46.004523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4886fe2e-2137-43cd-a399-3a606289f144 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:46.005007 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4886fe2e-2137-43cd-a399-3a606289f144 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:46.005443 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4886fe2e-2137-43cd-a399-3a606289f144 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:46.006173 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4886fe2e-2137-43cd-a399-3a606289f144 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:46.006730 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4886fe2e-2137-43cd-a399-3a606289f144 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:46.007188 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4886fe2e-2137-43cd-a399-3a606289f144 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:46.140527 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-4886fe2e-2137-43cd-a399-3a606289f144 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:46.148980 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-4886fe2e-2137-43cd-a399-3a606289f144 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1734 microversion: 2.1 time: 0.155509 Aug 19 21:13:46.150066 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 256/579] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:45 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:47.081473 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 21:13:47.082055 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Fri Aug 19 21:13:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 21:13:47.171095 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-b5531c5d-92bf-4708-a9f9-da793177c8e7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:47.171709 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-b5531c5d-92bf-4708-a9f9-da793177c8e7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:47.178768 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b5531c5d-92bf-4708-a9f9-da793177c8e7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:47.179373 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b5531c5d-92bf-4708-a9f9-da793177c8e7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:47.179806 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b5531c5d-92bf-4708-a9f9-da793177c8e7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:47.180492 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b5531c5d-92bf-4708-a9f9-da793177c8e7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:47.180944 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b5531c5d-92bf-4708-a9f9-da793177c8e7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:47.181366 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b5531c5d-92bf-4708-a9f9-da793177c8e7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:47.312366 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-b5531c5d-92bf-4708-a9f9-da793177c8e7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:47.314511 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:13:47.322626 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-b5531c5d-92bf-4708-a9f9-da793177c8e7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1734 microversion: 2.1 time: 0.155329 Aug 19 21:13:47.323181 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 324/580] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:47 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:48.344409 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-67443fd1-8db9-4ddb-8ec6-5b0d20872410 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:48.344922 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-67443fd1-8db9-4ddb-8ec6-5b0d20872410 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:48.352224 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-67443fd1-8db9-4ddb-8ec6-5b0d20872410 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:48.352701 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-67443fd1-8db9-4ddb-8ec6-5b0d20872410 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:48.353125 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-67443fd1-8db9-4ddb-8ec6-5b0d20872410 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:48.353829 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-67443fd1-8db9-4ddb-8ec6-5b0d20872410 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:48.354282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-67443fd1-8db9-4ddb-8ec6-5b0d20872410 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:48.354697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-67443fd1-8db9-4ddb-8ec6-5b0d20872410 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:48.493555 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-67443fd1-8db9-4ddb-8ec6-5b0d20872410 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:48.501752 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-67443fd1-8db9-4ddb-8ec6-5b0d20872410 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1734 microversion: 2.1 time: 0.161282 Aug 19 21:13:48.502343 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 257/581] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:48 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:49.524163 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8a8e3099-86da-41b9-a3de-8790dea5d1b3 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:49.524777 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8a8e3099-86da-41b9-a3de-8790dea5d1b3 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:49.532371 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8a8e3099-86da-41b9-a3de-8790dea5d1b3 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:49.532848 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8a8e3099-86da-41b9-a3de-8790dea5d1b3 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:49.533282 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8a8e3099-86da-41b9-a3de-8790dea5d1b3 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:49.534007 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8a8e3099-86da-41b9-a3de-8790dea5d1b3 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:49.534464 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8a8e3099-86da-41b9-a3de-8790dea5d1b3 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:49.534885 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8a8e3099-86da-41b9-a3de-8790dea5d1b3 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:49.666507 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8a8e3099-86da-41b9-a3de-8790dea5d1b3 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:49.674712 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8a8e3099-86da-41b9-a3de-8790dea5d1b3 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1734 microversion: 2.1 time: 0.154478 Aug 19 21:13:49.675265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 325/582] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:49 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:50.697554 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-ea76ec8f-1c54-4477-892c-3281c62a8c2c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:50.698214 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-ea76ec8f-1c54-4477-892c-3281c62a8c2c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:50.704800 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ea76ec8f-1c54-4477-892c-3281c62a8c2c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:50.705277 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ea76ec8f-1c54-4477-892c-3281c62a8c2c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:50.705705 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ea76ec8f-1c54-4477-892c-3281c62a8c2c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:50.706415 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ea76ec8f-1c54-4477-892c-3281c62a8c2c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:50.706859 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ea76ec8f-1c54-4477-892c-3281c62a8c2c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:50.707279 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ea76ec8f-1c54-4477-892c-3281c62a8c2c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:50.845062 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-ea76ec8f-1c54-4477-892c-3281c62a8c2c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:50.855450 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-ea76ec8f-1c54-4477-892c-3281c62a8c2c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1734 microversion: 2.1 time: 0.162719 Aug 19 21:13:50.856036 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 258/583] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:50 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:51.876939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ec6b6e5c-fe3f-41fd-9ebc-0faa46c92b1a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:51.877561 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ec6b6e5c-fe3f-41fd-9ebc-0faa46c92b1a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:51.885693 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ec6b6e5c-fe3f-41fd-9ebc-0faa46c92b1a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:51.886495 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ec6b6e5c-fe3f-41fd-9ebc-0faa46c92b1a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:51.886929 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ec6b6e5c-fe3f-41fd-9ebc-0faa46c92b1a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:51.887632 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ec6b6e5c-fe3f-41fd-9ebc-0faa46c92b1a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:51.888085 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ec6b6e5c-fe3f-41fd-9ebc-0faa46c92b1a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:51.888502 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ec6b6e5c-fe3f-41fd-9ebc-0faa46c92b1a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:52.032540 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ec6b6e5c-fe3f-41fd-9ebc-0faa46c92b1a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:52.041708 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ec6b6e5c-fe3f-41fd-9ebc-0faa46c92b1a tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1734 microversion: 2.1 time: 0.168781 Aug 19 21:13:52.042336 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 326/584] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:51 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:53.063059 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-2e97763e-de57-4a7c-b42b-87d565befa66 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:53.063651 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-2e97763e-de57-4a7c-b42b-87d565befa66 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:53.066073 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:13:53.072018 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2e97763e-de57-4a7c-b42b-87d565befa66 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:53.072509 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2e97763e-de57-4a7c-b42b-87d565befa66 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:53.072939 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2e97763e-de57-4a7c-b42b-87d565befa66 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:53.073642 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2e97763e-de57-4a7c-b42b-87d565befa66 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:53.074119 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2e97763e-de57-4a7c-b42b-87d565befa66 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:53.074605 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2e97763e-de57-4a7c-b42b-87d565befa66 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:53.214718 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-2e97763e-de57-4a7c-b42b-87d565befa66 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:53.223559 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-2e97763e-de57-4a7c-b42b-87d565befa66 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1734 microversion: 2.1 time: 0.164268 Aug 19 21:13:53.224145 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 259/585] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:53 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:53.869136 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a6ba3bf6-685d-42bd-aca4-da576d841c90 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:13:53.871514 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-a6ba3bf6-685d-42bd-aca4-da576d841c90 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:53.878445 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a6ba3bf6-685d-42bd-aca4-da576d841c90 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:53.878932 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a6ba3bf6-685d-42bd-aca4-da576d841c90 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:53.879377 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a6ba3bf6-685d-42bd-aca4-da576d841c90 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:53.880073 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a6ba3bf6-685d-42bd-aca4-da576d841c90 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:53.880526 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a6ba3bf6-685d-42bd-aca4-da576d841c90 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:53.880952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a6ba3bf6-685d-42bd-aca4-da576d841c90 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:53.958010 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-a6ba3bf6-685d-42bd-aca4-da576d841c90 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "POST /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c/action" status: 202 len: 0 microversion: 2.1 time: 0.093271 Aug 19 21:13:53.958653 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 327/586] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Aug 19 21:13:53 2022] POST /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:13:53.967948 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-46c84306-cff6-4581-974a-07a8e04e15a4 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:53.968558 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-46c84306-cff6-4581-974a-07a8e04e15a4 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:53.974702 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-46c84306-cff6-4581-974a-07a8e04e15a4 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:53.975720 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-46c84306-cff6-4581-974a-07a8e04e15a4 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:53.975917 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-46c84306-cff6-4581-974a-07a8e04e15a4 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:53.976508 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-46c84306-cff6-4581-974a-07a8e04e15a4 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:53.976974 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-46c84306-cff6-4581-974a-07a8e04e15a4 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:53.977385 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-46c84306-cff6-4581-974a-07a8e04e15a4 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:54.227836 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-46c84306-cff6-4581-974a-07a8e04e15a4 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:54.236405 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-46c84306-cff6-4581-974a-07a8e04e15a4 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1753 microversion: 2.1 time: 0.272331 Aug 19 21:13:54.237100 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 260/587] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:53 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1753 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:54.247271 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-b514c6f7-18a1-4cc0-b3bf-96fd61c813e2 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:54.248392 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-b514c6f7-18a1-4cc0-b3bf-96fd61c813e2 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:54.256587 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b514c6f7-18a1-4cc0-b3bf-96fd61c813e2 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:54.257485 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b514c6f7-18a1-4cc0-b3bf-96fd61c813e2 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:54.257702 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b514c6f7-18a1-4cc0-b3bf-96fd61c813e2 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:54.258700 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b514c6f7-18a1-4cc0-b3bf-96fd61c813e2 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:54.259146 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b514c6f7-18a1-4cc0-b3bf-96fd61c813e2 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:54.259647 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b514c6f7-18a1-4cc0-b3bf-96fd61c813e2 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:54.465505 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-b514c6f7-18a1-4cc0-b3bf-96fd61c813e2 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:54.474004 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-b514c6f7-18a1-4cc0-b3bf-96fd61c813e2 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1734 microversion: 2.1 time: 0.232968 Aug 19 21:13:54.474646 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 328/588] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:54 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1734 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:13:55.262891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-a520b131-96a1-490b-8ed2-527061f48f09 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:55.264025 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-a520b131-96a1-490b-8ed2-527061f48f09 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:55.275427 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a520b131-96a1-490b-8ed2-527061f48f09 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:55.275921 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a520b131-96a1-490b-8ed2-527061f48f09 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:55.276587 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a520b131-96a1-490b-8ed2-527061f48f09 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:55.277865 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a520b131-96a1-490b-8ed2-527061f48f09 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:55.278677 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a520b131-96a1-490b-8ed2-527061f48f09 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:55.279441 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a520b131-96a1-490b-8ed2-527061f48f09 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:55.444903 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-a520b131-96a1-490b-8ed2-527061f48f09 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:55.456329 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-a520b131-96a1-490b-8ed2-527061f48f09 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1758 microversion: 2.1 time: 0.200635 Aug 19 21:13:55.457009 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 261/589] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:55 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1758 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:55.497036 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-d81b8910-c5c4-4176-9161-129030f904f7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:55.497640 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-d81b8910-c5c4-4176-9161-129030f904f7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:55.504088 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d81b8910-c5c4-4176-9161-129030f904f7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:55.504563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d81b8910-c5c4-4176-9161-129030f904f7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:55.504997 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d81b8910-c5c4-4176-9161-129030f904f7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:55.505673 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d81b8910-c5c4-4176-9161-129030f904f7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:55.506145 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d81b8910-c5c4-4176-9161-129030f904f7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:55.507784 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d81b8910-c5c4-4176-9161-129030f904f7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:55.637464 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-d81b8910-c5c4-4176-9161-129030f904f7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:55.645615 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-d81b8910-c5c4-4176-9161-129030f904f7 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1734 microversion: 2.1 time: 0.152838 Aug 19 21:13:55.646192 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 329/590] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:55 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:13:56.480001 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-47389c68-5777-430b-84dc-424146d6afd5 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:56.480546 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-47389c68-5777-430b-84dc-424146d6afd5 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:56.486480 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-47389c68-5777-430b-84dc-424146d6afd5 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:56.486962 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-47389c68-5777-430b-84dc-424146d6afd5 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:56.487394 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-47389c68-5777-430b-84dc-424146d6afd5 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:56.488079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-47389c68-5777-430b-84dc-424146d6afd5 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:56.488530 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-47389c68-5777-430b-84dc-424146d6afd5 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:56.488952 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-47389c68-5777-430b-84dc-424146d6afd5 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:56.630273 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-47389c68-5777-430b-84dc-424146d6afd5 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:56.639595 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-47389c68-5777-430b-84dc-424146d6afd5 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1758 microversion: 2.1 time: 0.164678 Aug 19 21:13:56.640164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 262/591] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:56 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:56.667582 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-62c53ec8-a491-4a04-837f-a52fcb70a758 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:56.668189 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-62c53ec8-a491-4a04-837f-a52fcb70a758 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:56.674926 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-62c53ec8-a491-4a04-837f-a52fcb70a758 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:56.675403 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-62c53ec8-a491-4a04-837f-a52fcb70a758 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:56.675833 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-62c53ec8-a491-4a04-837f-a52fcb70a758 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:56.676511 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-62c53ec8-a491-4a04-837f-a52fcb70a758 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:56.676957 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-62c53ec8-a491-4a04-837f-a52fcb70a758 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:56.677373 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-62c53ec8-a491-4a04-837f-a52fcb70a758 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:56.816866 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-62c53ec8-a491-4a04-837f-a52fcb70a758 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:56.825266 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-62c53ec8-a491-4a04-837f-a52fcb70a758 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1734 microversion: 2.1 time: 0.162541 Aug 19 21:13:56.825847 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 330/592] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:56 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:57.661277 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-fc52b564-a27c-4975-86dc-fd53fa71adb7 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:57.662061 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-fc52b564-a27c-4975-86dc-fd53fa71adb7 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:57.669143 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fc52b564-a27c-4975-86dc-fd53fa71adb7 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:57.669639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fc52b564-a27c-4975-86dc-fd53fa71adb7 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:57.670111 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fc52b564-a27c-4975-86dc-fd53fa71adb7 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:57.670814 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fc52b564-a27c-4975-86dc-fd53fa71adb7 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:57.671271 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fc52b564-a27c-4975-86dc-fd53fa71adb7 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:57.671693 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fc52b564-a27c-4975-86dc-fd53fa71adb7 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:57.818132 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-fc52b564-a27c-4975-86dc-fd53fa71adb7 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:57.827462 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-fc52b564-a27c-4975-86dc-fd53fa71adb7 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1758 microversion: 2.1 time: 0.170127 Aug 19 21:13:57.828071 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 263/593] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:57 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:57.846287 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c0439885-97d8-486c-87cd-417b6da87f66 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:57.846891 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-c0439885-97d8-486c-87cd-417b6da87f66 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:57.853647 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c0439885-97d8-486c-87cd-417b6da87f66 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:57.854276 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c0439885-97d8-486c-87cd-417b6da87f66 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:57.854756 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c0439885-97d8-486c-87cd-417b6da87f66 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:57.855440 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c0439885-97d8-486c-87cd-417b6da87f66 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:57.855888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c0439885-97d8-486c-87cd-417b6da87f66 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:57.856304 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c0439885-97d8-486c-87cd-417b6da87f66 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:57.998109 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c0439885-97d8-486c-87cd-417b6da87f66 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:58.006590 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-c0439885-97d8-486c-87cd-417b6da87f66 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1734 microversion: 2.1 time: 0.163847 Aug 19 21:13:58.007011 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 331/594] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:57 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:58.848846 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-078707c4-f6a9-4e80-802c-cd211d4022bc tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:58.849441 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-078707c4-f6a9-4e80-802c-cd211d4022bc tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:58.856712 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-078707c4-f6a9-4e80-802c-cd211d4022bc tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:58.857192 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-078707c4-f6a9-4e80-802c-cd211d4022bc tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:58.857618 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-078707c4-f6a9-4e80-802c-cd211d4022bc tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:58.858355 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-078707c4-f6a9-4e80-802c-cd211d4022bc tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:58.858799 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-078707c4-f6a9-4e80-802c-cd211d4022bc tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:58.859238 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-078707c4-f6a9-4e80-802c-cd211d4022bc tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:59.011367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-078707c4-f6a9-4e80-802c-cd211d4022bc tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:59.020197 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-078707c4-f6a9-4e80-802c-cd211d4022bc tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1758 microversion: 2.1 time: 0.175179 Aug 19 21:13:59.020799 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 264/595] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:58 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:13:59.028607 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-30ba4900-2a9c-4f45-abdb-4e378998d6bb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:13:59.029219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-30ba4900-2a9c-4f45-abdb-4e378998d6bb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:13:59.036019 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-30ba4900-2a9c-4f45-abdb-4e378998d6bb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:59.036512 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-30ba4900-2a9c-4f45-abdb-4e378998d6bb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:59.037044 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-30ba4900-2a9c-4f45-abdb-4e378998d6bb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:59.037790 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-30ba4900-2a9c-4f45-abdb-4e378998d6bb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:13:59.038149 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-30ba4900-2a9c-4f45-abdb-4e378998d6bb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:13:59.038576 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-30ba4900-2a9c-4f45-abdb-4e378998d6bb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:13:59.177790 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-30ba4900-2a9c-4f45-abdb-4e378998d6bb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:13:59.186922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-30ba4900-2a9c-4f45-abdb-4e378998d6bb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1734 microversion: 2.1 time: 0.162250 Aug 19 21:13:59.187493 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 332/596] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:13:59 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:00.043591 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-18871cd1-fb7e-4276-b9e1-2af944a2b593 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:00.044183 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-18871cd1-fb7e-4276-b9e1-2af944a2b593 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:00.050975 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-18871cd1-fb7e-4276-b9e1-2af944a2b593 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:00.051457 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-18871cd1-fb7e-4276-b9e1-2af944a2b593 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:00.051890 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-18871cd1-fb7e-4276-b9e1-2af944a2b593 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:00.052588 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-18871cd1-fb7e-4276-b9e1-2af944a2b593 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:00.053044 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-18871cd1-fb7e-4276-b9e1-2af944a2b593 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:00.053464 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-18871cd1-fb7e-4276-b9e1-2af944a2b593 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:00.208849 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-18871cd1-fb7e-4276-b9e1-2af944a2b593 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:00.210517 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-13276283-ceed-457a-a982-1d90b11a2f26 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:00.211137 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-13276283-ceed-457a-a982-1d90b11a2f26 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:00.217908 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-13276283-ceed-457a-a982-1d90b11a2f26 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:00.218401 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-13276283-ceed-457a-a982-1d90b11a2f26 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:00.218636 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-18871cd1-fb7e-4276-b9e1-2af944a2b593 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1758 microversion: 2.1 time: 0.178889 Aug 19 21:14:00.218836 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-13276283-ceed-457a-a982-1d90b11a2f26 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:00.219227 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 265/597] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:00 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:00.220043 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-13276283-ceed-457a-a982-1d90b11a2f26 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:00.220507 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-13276283-ceed-457a-a982-1d90b11a2f26 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:00.221102 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-13276283-ceed-457a-a982-1d90b11a2f26 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:00.370204 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-13276283-ceed-457a-a982-1d90b11a2f26 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:00.380729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-13276283-ceed-457a-a982-1d90b11a2f26 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1734 microversion: 2.1 time: 0.175418 Aug 19 21:14:00.382141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 333/598] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:00 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:14:01.240675 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-8c44b612-b00c-4cfc-9316-3fc42ad54b8d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:01.241513 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-8c44b612-b00c-4cfc-9316-3fc42ad54b8d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:01.248771 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8c44b612-b00c-4cfc-9316-3fc42ad54b8d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:01.249255 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8c44b612-b00c-4cfc-9316-3fc42ad54b8d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:01.249677 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8c44b612-b00c-4cfc-9316-3fc42ad54b8d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:01.250401 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8c44b612-b00c-4cfc-9316-3fc42ad54b8d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:01.250851 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8c44b612-b00c-4cfc-9316-3fc42ad54b8d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:01.251287 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8c44b612-b00c-4cfc-9316-3fc42ad54b8d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:01.403360 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-58dbb0fd-b67a-4d06-8dda-659bc7f965e6 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:01.403938 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-58dbb0fd-b67a-4d06-8dda-659bc7f965e6 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:01.415891 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58dbb0fd-b67a-4d06-8dda-659bc7f965e6 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:01.416390 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58dbb0fd-b67a-4d06-8dda-659bc7f965e6 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:01.416823 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58dbb0fd-b67a-4d06-8dda-659bc7f965e6 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:01.417572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58dbb0fd-b67a-4d06-8dda-659bc7f965e6 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:01.418057 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58dbb0fd-b67a-4d06-8dda-659bc7f965e6 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:01.418481 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58dbb0fd-b67a-4d06-8dda-659bc7f965e6 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:01.738471 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-8c44b612-b00c-4cfc-9316-3fc42ad54b8d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:01.743632 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-58dbb0fd-b67a-4d06-8dda-659bc7f965e6 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:01.748209 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-8c44b612-b00c-4cfc-9316-3fc42ad54b8d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1758 microversion: 2.1 time: 0.511060 Aug 19 21:14:01.748510 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 266/599] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:01 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1758 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:01.752274 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-58dbb0fd-b67a-4d06-8dda-659bc7f965e6 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1734 microversion: 2.1 time: 0.352928 Aug 19 21:14:01.752999 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 334/600] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:01 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1734 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:02.770324 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-f8268658-b0bd-46aa-ab65-0594fa44b87f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:02.770907 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-f8268658-b0bd-46aa-ab65-0594fa44b87f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:02.773721 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3009fdb1-631e-4f82-8aeb-0b121d2c15d4 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:02.774372 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-3009fdb1-631e-4f82-8aeb-0b121d2c15d4 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:02.777815 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f8268658-b0bd-46aa-ab65-0594fa44b87f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:02.778920 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f8268658-b0bd-46aa-ab65-0594fa44b87f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:02.779368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f8268658-b0bd-46aa-ab65-0594fa44b87f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:02.780089 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f8268658-b0bd-46aa-ab65-0594fa44b87f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:02.780608 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f8268658-b0bd-46aa-ab65-0594fa44b87f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:02.781057 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f8268658-b0bd-46aa-ab65-0594fa44b87f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:02.781403 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3009fdb1-631e-4f82-8aeb-0b121d2c15d4 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:02.781931 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3009fdb1-631e-4f82-8aeb-0b121d2c15d4 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:02.782375 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3009fdb1-631e-4f82-8aeb-0b121d2c15d4 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:02.783099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3009fdb1-631e-4f82-8aeb-0b121d2c15d4 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:02.783558 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3009fdb1-631e-4f82-8aeb-0b121d2c15d4 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:02.783981 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3009fdb1-631e-4f82-8aeb-0b121d2c15d4 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:02.990699 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3009fdb1-631e-4f82-8aeb-0b121d2c15d4 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:02.999618 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-3009fdb1-631e-4f82-8aeb-0b121d2c15d4 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1734 microversion: 2.1 time: 0.229762 Aug 19 21:14:03.000186 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 335/601] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:02 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1734 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:14:03.000300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-f8268658-b0bd-46aa-ab65-0594fa44b87f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:03.009813 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-f8268658-b0bd-46aa-ab65-0594fa44b87f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1758 microversion: 2.1 time: 0.243386 Aug 19 21:14:03.010469 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 267/602] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:02 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1758 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:04.022453 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-4ddae9d0-532b-4ede-85cf-3026168472b8 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:04.023965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-4ddae9d0-532b-4ede-85cf-3026168472b8 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:04.034055 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4ddae9d0-532b-4ede-85cf-3026168472b8 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:04.034547 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4ddae9d0-532b-4ede-85cf-3026168472b8 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:04.034780 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-8ae7525d-d4c8-414d-b2df-012d8fc380fa tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:04.035218 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4ddae9d0-532b-4ede-85cf-3026168472b8 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:04.035485 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-8ae7525d-d4c8-414d-b2df-012d8fc380fa tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:04.035694 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4ddae9d0-532b-4ede-85cf-3026168472b8 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:04.036149 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4ddae9d0-532b-4ede-85cf-3026168472b8 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:04.036572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4ddae9d0-532b-4ede-85cf-3026168472b8 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:04.042932 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8ae7525d-d4c8-414d-b2df-012d8fc380fa tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:04.043449 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8ae7525d-d4c8-414d-b2df-012d8fc380fa tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:04.043969 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8ae7525d-d4c8-414d-b2df-012d8fc380fa tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:04.044744 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8ae7525d-d4c8-414d-b2df-012d8fc380fa tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:04.045433 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8ae7525d-d4c8-414d-b2df-012d8fc380fa tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:04.045963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8ae7525d-d4c8-414d-b2df-012d8fc380fa tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:04.247804 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-4ddae9d0-532b-4ede-85cf-3026168472b8 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:04.256424 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-4ddae9d0-532b-4ede-85cf-3026168472b8 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1734 microversion: 2.1 time: 0.237906 Aug 19 21:14:04.257013 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 336/603] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:04 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1734 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:04.272304 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-8ae7525d-d4c8-414d-b2df-012d8fc380fa tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:04.287974 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-8ae7525d-d4c8-414d-b2df-012d8fc380fa tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1758 microversion: 2.1 time: 0.259270 Aug 19 21:14:04.288935 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 268/604] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:04 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1758 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:05.280648 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-88e914d1-633f-4724-93b5-60182a4cd901 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:05.281283 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-88e914d1-633f-4724-93b5-60182a4cd901 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:05.291715 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-88e914d1-633f-4724-93b5-60182a4cd901 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:05.292193 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-88e914d1-633f-4724-93b5-60182a4cd901 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:05.292621 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-88e914d1-633f-4724-93b5-60182a4cd901 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:05.293312 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-88e914d1-633f-4724-93b5-60182a4cd901 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:05.293782 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-88e914d1-633f-4724-93b5-60182a4cd901 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:05.294205 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-88e914d1-633f-4724-93b5-60182a4cd901 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:05.310031 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-0a232ef8-fa2f-400a-b43a-9067c3808a8f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:05.310647 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-0a232ef8-fa2f-400a-b43a-9067c3808a8f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:05.317540 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0a232ef8-fa2f-400a-b43a-9067c3808a8f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:05.318146 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0a232ef8-fa2f-400a-b43a-9067c3808a8f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:05.318589 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0a232ef8-fa2f-400a-b43a-9067c3808a8f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:05.319290 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0a232ef8-fa2f-400a-b43a-9067c3808a8f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:05.319782 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0a232ef8-fa2f-400a-b43a-9067c3808a8f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:05.320293 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0a232ef8-fa2f-400a-b43a-9067c3808a8f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:05.507946 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-88e914d1-633f-4724-93b5-60182a4cd901 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:05.518612 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-88e914d1-633f-4724-93b5-60182a4cd901 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1714 microversion: 2.1 time: 0.242241 Aug 19 21:14:05.519205 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 337/605] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:05 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1714 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:05.526606 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-0a232ef8-fa2f-400a-b43a-9067c3808a8f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:05.545404 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-0a232ef8-fa2f-400a-b43a-9067c3808a8f tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1758 microversion: 2.1 time: 0.237483 Aug 19 21:14:05.545404 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 269/606] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:05 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1758 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:14:05.641082 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0b2bb348-7321-4a05-8f38-e6dacb7ed070 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:05.641581 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0b2bb348-7321-4a05-8f38-e6dacb7ed070 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:05.647632 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0b2bb348-7321-4a05-8f38-e6dacb7ed070 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:05.648825 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0b2bb348-7321-4a05-8f38-e6dacb7ed070 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:05.649273 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0b2bb348-7321-4a05-8f38-e6dacb7ed070 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:05.650112 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0b2bb348-7321-4a05-8f38-e6dacb7ed070 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:05.650570 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0b2bb348-7321-4a05-8f38-e6dacb7ed070 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:05.650994 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0b2bb348-7321-4a05-8f38-e6dacb7ed070 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:05.783641 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-0b2bb348-7321-4a05-8f38-e6dacb7ed070 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] HTTP exception thrown: Cannot 'detach_volume' instance 7df3ead0-b255-4b0c-8fa7-f9ae80138539 while it is in vm_state rescued Aug 19 21:14:05.785259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0b2bb348-7321-4a05-8f38-e6dacb7ed070 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Request method failure captured: Aug 19 21:14:05.785259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: DELETE /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539/os-volume_attachments/c7eb9ec7-6490-41fc-959e-4c2f4cec33b1 HTTP/1.1 Aug 19 21:14:05.785259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:14:05.785259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:14:05.785259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:14:05.785259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:14:05.785259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:14:05.785259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:14:05.785259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:14:05.785259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:14:05.785259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__u_fqu6__XAfEE8we4aMURTivVATLB4jAgDmOFji8LAe6kA4gLjm1nrouNEf5jjDjNj26q2gqZM2Is0Dwmcg8wVlRCJeDOlaq0WksfDdNjKfw7dq4UB7lXlKAtdfsuLSIAySQq0SR_EwssRHXqVK43vCJaIMBR00xJyCTcakpc4R8U Aug 19 21:14:05.785259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:14:05.785259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:14:05.785259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:14:05.785259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:14:05.785259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:14:05.785259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:14:05.785259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: 1c4004ba973b4454865b889d6d1e049a Aug 19 21:14:05.785259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1218485444 Aug 19 21:14:05.785259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:14:05.785259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:14:05.787289 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1c4004ba973b4454865b889d6d1e049a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c4004ba973b4454865b889d6d1e049a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1c4004ba973b4454865b889d6d1e049a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c4004ba973b4454865b889d6d1e049a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:14:05.787289 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1218485444 Aug 19 21:14:05.787289 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: 1c4004ba973b4454865b889d6d1e049a Aug 19 21:14:05.787289 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1218485444 Aug 19 21:14:05.787289 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-ServerRescueNegativeTestJSON-1218485444-project Aug 19 21:14:05.787289 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:14:05.787289 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:14:05.787289 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: e8e345dbc2114b718c98c70844352c63 Aug 19 21:14:05.787289 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1218485444-project Aug 19 21:14:05.787289 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: > Aug 19 21:14:05.787289 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Cannot 'detach_volume' instance 7df3ead0-b255-4b0c-8fa7-f9ae80138539 while it is in vm_state rescued Aug 19 21:14:05.789361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'server_id': '7df3ead0-b255-4b0c-8fa7-f9ae80138539', 'id': 'c7eb9ec7-6490-41fc-959e-4c2f4cec33b1'} Aug 19 21:14:05.789361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:14:05.789361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:14:05.789361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 19 21:14:05.789361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 19 21:14:05.789361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 19 21:14:05.789361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 19 21:14:05.789361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 19 21:14:05.789361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 19 21:14:05.789361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7df3ead0-b255-4b0c-8fa7-f9ae80138539 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 19 21:14:05.789361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:14:05.789361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:14:05.789361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:14:05.789361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:14:05.789361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:14:05.789361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:14:05.789361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:14:05.789361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:14:05.789361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:14:05.789361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:14:05.792261 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 19 21:14:05.792261 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 19 21:14:05.792261 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 19 21:14:05.792261 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 19 21:14:05.792261 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7df3ead0-b255-4b0c-8fa7-f9ae80138539 while it is in vm_state rescued Aug 19 21:14:05.792261 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:14:05.792261 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:14:05.792261 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:14:05.792261 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:14:05.792261 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:14:05.792261 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:14:05.792261 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:14:05.792261 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:14:05.792261 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7df3ead0-b255-4b0c-8fa7-f9ae80138539 while it is in vm_state rescued Aug 19 21:14:05.792261 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:14:05.792261 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0b2bb348-7321-4a05-8f38-e6dacb7ed070 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Returning 409 to user: Cannot 'detach_volume' instance 7df3ead0-b255-4b0c-8fa7-f9ae80138539 while it is in vm_state rescued {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:14:05.794660 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0b2bb348-7321-4a05-8f38-e6dacb7ed070 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539/os-volume_attachments/c7eb9ec7-6490-41fc-959e-4c2f4cec33b1" status: 409 len: 152 microversion: 2.1 time: 0.149743 Aug 19 21:14:05.794660 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 338/607] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Aug 19 21:14:05 2022] DELETE /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539/os-volume_attachments/c7eb9ec7-6490-41fc-959e-4c2f4cec33b1 => generated 152 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 19 21:14:05.796320 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-dd3ee2ef-a542-4cef-96ab-e190f2d77da2 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:14:05.796887 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-dd3ee2ef-a542-4cef-96ab-e190f2d77da2 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:05.802914 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dd3ee2ef-a542-4cef-96ab-e190f2d77da2 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:05.803414 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dd3ee2ef-a542-4cef-96ab-e190f2d77da2 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:05.803907 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dd3ee2ef-a542-4cef-96ab-e190f2d77da2 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:05.805240 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dd3ee2ef-a542-4cef-96ab-e190f2d77da2 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:05.806464 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dd3ee2ef-a542-4cef-96ab-e190f2d77da2 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:05.806464 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dd3ee2ef-a542-4cef-96ab-e190f2d77da2 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:05.864875 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:14:05.875710 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-dd3ee2ef-a542-4cef-96ab-e190f2d77da2 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "POST /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539/action" status: 202 len: 0 microversion: 2.1 time: 0.083361 Aug 19 21:14:05.876328 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 270/608] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Aug 19 21:14:05 2022] POST /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:14:05.885305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-6252c687-6252-4f08-9545-aaadc4885fdc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:05.885968 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-6252c687-6252-4f08-9545-aaadc4885fdc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:05.892797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6252c687-6252-4f08-9545-aaadc4885fdc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:05.893280 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6252c687-6252-4f08-9545-aaadc4885fdc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:05.893710 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6252c687-6252-4f08-9545-aaadc4885fdc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:05.894433 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6252c687-6252-4f08-9545-aaadc4885fdc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:05.894868 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6252c687-6252-4f08-9545-aaadc4885fdc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:05.895286 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6252c687-6252-4f08-9545-aaadc4885fdc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:06.027798 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-6252c687-6252-4f08-9545-aaadc4885fdc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:06.036267 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-6252c687-6252-4f08-9545-aaadc4885fdc tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1722 microversion: 2.1 time: 0.155644 Aug 19 21:14:06.036833 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 339/609] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:05 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:06.565891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-12dd3b61-f1aa-49d2-b02c-d91f47ab42ec tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:06.566616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-12dd3b61-f1aa-49d2-b02c-d91f47ab42ec tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:06.574029 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-12dd3b61-f1aa-49d2-b02c-d91f47ab42ec tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:06.574515 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-12dd3b61-f1aa-49d2-b02c-d91f47ab42ec tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:06.574947 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-12dd3b61-f1aa-49d2-b02c-d91f47ab42ec tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:06.575646 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-12dd3b61-f1aa-49d2-b02c-d91f47ab42ec tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:06.576096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-12dd3b61-f1aa-49d2-b02c-d91f47ab42ec tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:06.576513 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-12dd3b61-f1aa-49d2-b02c-d91f47ab42ec tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:06.775889 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-12dd3b61-f1aa-49d2-b02c-d91f47ab42ec tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:06.784659 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-12dd3b61-f1aa-49d2-b02c-d91f47ab42ec tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1761 microversion: 2.1 time: 0.223804 Aug 19 21:14:06.785519 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 271/610] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:06 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1761 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:07.057503 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ea9084a9-3ea1-48ea-8939-78d49dfbff5d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:07.058129 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ea9084a9-3ea1-48ea-8939-78d49dfbff5d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:07.064857 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea9084a9-3ea1-48ea-8939-78d49dfbff5d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:07.065406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea9084a9-3ea1-48ea-8939-78d49dfbff5d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:07.065866 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea9084a9-3ea1-48ea-8939-78d49dfbff5d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:07.066570 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea9084a9-3ea1-48ea-8939-78d49dfbff5d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:07.067021 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea9084a9-3ea1-48ea-8939-78d49dfbff5d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:07.067445 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ea9084a9-3ea1-48ea-8939-78d49dfbff5d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:07.083410 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:14:07.218752 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ea9084a9-3ea1-48ea-8939-78d49dfbff5d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:07.228093 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ea9084a9-3ea1-48ea-8939-78d49dfbff5d tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1722 microversion: 2.1 time: 0.175051 Aug 19 21:14:07.228660 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 340/611] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:07 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:08.250780 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-32e0dbbd-7dec-43ce-a03f-f59303d4ea31 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:08.251383 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-32e0dbbd-7dec-43ce-a03f-f59303d4ea31 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:08.258577 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-32e0dbbd-7dec-43ce-a03f-f59303d4ea31 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:08.259059 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-32e0dbbd-7dec-43ce-a03f-f59303d4ea31 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:08.259486 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-32e0dbbd-7dec-43ce-a03f-f59303d4ea31 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:08.260167 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-32e0dbbd-7dec-43ce-a03f-f59303d4ea31 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:08.260613 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-32e0dbbd-7dec-43ce-a03f-f59303d4ea31 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:08.261030 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-32e0dbbd-7dec-43ce-a03f-f59303d4ea31 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:08.390642 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-32e0dbbd-7dec-43ce-a03f-f59303d4ea31 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:08.399808 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-32e0dbbd-7dec-43ce-a03f-f59303d4ea31 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1722 microversion: 2.1 time: 0.152874 Aug 19 21:14:08.400367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 272/612] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:08 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:09.424597 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8c01b1d5-2395-47c4-bd91-3dbecf72c029 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:09.425143 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8c01b1d5-2395-47c4-bd91-3dbecf72c029 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:09.432296 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c01b1d5-2395-47c4-bd91-3dbecf72c029 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:09.432791 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c01b1d5-2395-47c4-bd91-3dbecf72c029 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:09.433258 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c01b1d5-2395-47c4-bd91-3dbecf72c029 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:09.433999 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c01b1d5-2395-47c4-bd91-3dbecf72c029 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:09.434462 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c01b1d5-2395-47c4-bd91-3dbecf72c029 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:09.434890 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c01b1d5-2395-47c4-bd91-3dbecf72c029 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:09.576202 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8c01b1d5-2395-47c4-bd91-3dbecf72c029 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:09.584607 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8c01b1d5-2395-47c4-bd91-3dbecf72c029 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1722 microversion: 2.1 time: 0.163959 Aug 19 21:14:09.585177 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 341/613] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:09 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:10.606811 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-02a38c99-f880-4b63-8f75-38c167ebe161 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:10.607414 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-02a38c99-f880-4b63-8f75-38c167ebe161 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:10.613843 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-02a38c99-f880-4b63-8f75-38c167ebe161 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:10.614325 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-02a38c99-f880-4b63-8f75-38c167ebe161 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:10.614751 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-02a38c99-f880-4b63-8f75-38c167ebe161 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:10.615425 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-02a38c99-f880-4b63-8f75-38c167ebe161 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:10.615871 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-02a38c99-f880-4b63-8f75-38c167ebe161 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:10.616287 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-02a38c99-f880-4b63-8f75-38c167ebe161 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:10.756572 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-02a38c99-f880-4b63-8f75-38c167ebe161 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:10.769102 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-02a38c99-f880-4b63-8f75-38c167ebe161 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1728 microversion: 2.1 time: 0.166100 Aug 19 21:14:10.769777 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 273/614] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:10 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:10.799009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-1d957de9-c3fc-4a6b-adf5-8c3585eaa7ce tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:10.799523 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-1d957de9-c3fc-4a6b-adf5-8c3585eaa7ce tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:10.802633 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=48 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:14:10.808964 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1d957de9-c3fc-4a6b-adf5-8c3585eaa7ce tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:10.809645 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1d957de9-c3fc-4a6b-adf5-8c3585eaa7ce tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:10.810120 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1d957de9-c3fc-4a6b-adf5-8c3585eaa7ce tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:10.811062 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1d957de9-c3fc-4a6b-adf5-8c3585eaa7ce tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:10.811881 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1d957de9-c3fc-4a6b-adf5-8c3585eaa7ce tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:10.812360 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1d957de9-c3fc-4a6b-adf5-8c3585eaa7ce tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:10.909502 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-1d957de9-c3fc-4a6b-adf5-8c3585eaa7ce tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115331 Aug 19 21:14:10.910149 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 342/615] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Aug 19 21:14:10 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:14:12.077406 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-312787b8-5627-4ade-a559-d90f0f210a3b req-53514a76-6afb-4b5a-aa37-22cb6a062a58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7df3ead0-b255-4b0c-8fa7-f9ae80138539", "tag": "3a4cbe7a-9f6d-4454-9ea2-92df8cfb98b9"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:14:12.088262 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-312787b8-5627-4ade-a559-d90f0f210a3b req-53514a76-6afb-4b5a-aa37-22cb6a062a58 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:12.088747 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-312787b8-5627-4ade-a559-d90f0f210a3b req-53514a76-6afb-4b5a-aa37-22cb6a062a58 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:12.089182 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-312787b8-5627-4ade-a559-d90f0f210a3b req-53514a76-6afb-4b5a-aa37-22cb6a062a58 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:12.102051 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-312787b8-5627-4ade-a559-d90f0f210a3b req-53514a76-6afb-4b5a-aa37-22cb6a062a58 service nova] Creating event network-changed:3a4cbe7a-9f6d-4454-9ea2-92df8cfb98b9 for instance 7df3ead0-b255-4b0c-8fa7-f9ae80138539 on hv-cinder-85220 Aug 19 21:14:12.107920 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-312787b8-5627-4ade-a559-d90f0f210a3b req-53514a76-6afb-4b5a-aa37-22cb6a062a58 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167459 Aug 19 21:14:12.108723 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 274/616] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:14:14.124596 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-87e58fb2-2070-4513-9560-e20b334ff731 req-8fe5c570-8526-4806-b083-5e1c8da5cabb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7df3ead0-b255-4b0c-8fa7-f9ae80138539", "tag": "3a4cbe7a-9f6d-4454-9ea2-92df8cfb98b9"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:14:14.135870 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-87e58fb2-2070-4513-9560-e20b334ff731 req-8fe5c570-8526-4806-b083-5e1c8da5cabb service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:14.136600 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-87e58fb2-2070-4513-9560-e20b334ff731 req-8fe5c570-8526-4806-b083-5e1c8da5cabb service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:14.137027 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-87e58fb2-2070-4513-9560-e20b334ff731 req-8fe5c570-8526-4806-b083-5e1c8da5cabb service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:14.149878 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-87e58fb2-2070-4513-9560-e20b334ff731 req-8fe5c570-8526-4806-b083-5e1c8da5cabb service nova] Creating event network-changed:3a4cbe7a-9f6d-4454-9ea2-92df8cfb98b9 for instance 7df3ead0-b255-4b0c-8fa7-f9ae80138539 on hv-cinder-85220 Aug 19 21:14:14.155066 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-87e58fb2-2070-4513-9560-e20b334ff731 req-8fe5c570-8526-4806-b083-5e1c8da5cabb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035000 Aug 19 21:14:14.155802 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 343/617] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:14:14.982520 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d8688974-022f-49ca-93ce-ac946e8fd87a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:14.983781 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-d8688974-022f-49ca-93ce-ac946e8fd87a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:14.996196 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d8688974-022f-49ca-93ce-ac946e8fd87a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:14.997407 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d8688974-022f-49ca-93ce-ac946e8fd87a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:14.998239 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d8688974-022f-49ca-93ce-ac946e8fd87a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:14.999515 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d8688974-022f-49ca-93ce-ac946e8fd87a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:15.000359 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d8688974-022f-49ca-93ce-ac946e8fd87a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:15.001141 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d8688974-022f-49ca-93ce-ac946e8fd87a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:15.145693 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.objects.instance [None req-d8688974-022f-49ca-93ce-ac946e8fd87a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lazy-loading 'services' on Instance uuid d7e25852-2606-4138-b039-56a9ed0b7f1e {{(pid=120876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:14:15.269878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-d8688974-022f-49ca-93ce-ac946e8fd87a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e/os-volume_attachments/68ecec5e-f2a3-41f9-a50a-f9c110281fe3" status: 202 len: 0 microversion: 2.1 time: 0.428163 Aug 19 21:14:15.270638 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 275/618] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Aug 19 21:14:14 2022] DELETE /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e/os-volume_attachments/68ecec5e-f2a3-41f9-a50a-f9c110281fe3 => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:14:16.407964 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-f16eb32a-8d80-4cd6-a1b9-a177a4e99b62 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:14:16.415781 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f16eb32a-8d80-4cd6-a1b9-a177a4e99b62 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:16.416126 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f16eb32a-8d80-4cd6-a1b9-a177a4e99b62 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:16.416843 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f16eb32a-8d80-4cd6-a1b9-a177a4e99b62 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:16.440275 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-f16eb32a-8d80-4cd6-a1b9-a177a4e99b62 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Going to try to stop instance {{(pid=120877) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 19 21:14:16.484994 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-f16eb32a-8d80-4cd6-a1b9-a177a4e99b62 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "POST /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e/action" status: 202 len: 0 microversion: 2.1 time: 0.081433 Aug 19 21:14:16.485590 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 344/619] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Aug 19 21:14:16 2022] POST /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:14:16.495170 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-2c858c22-e8a5-480d-bf7d-aa9ac81e1777 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:16.495866 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-2c858c22-e8a5-480d-bf7d-aa9ac81e1777 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:16.502177 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2c858c22-e8a5-480d-bf7d-aa9ac81e1777 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:16.502896 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2c858c22-e8a5-480d-bf7d-aa9ac81e1777 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:16.503319 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2c858c22-e8a5-480d-bf7d-aa9ac81e1777 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:16.504009 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2c858c22-e8a5-480d-bf7d-aa9ac81e1777 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:16.504456 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2c858c22-e8a5-480d-bf7d-aa9ac81e1777 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:16.504872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2c858c22-e8a5-480d-bf7d-aa9ac81e1777 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:16.650081 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-2c858c22-e8a5-480d-bf7d-aa9ac81e1777 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:16.658150 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-2c858c22-e8a5-480d-bf7d-aa9ac81e1777 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1678 microversion: 2.1 time: 0.167900 Aug 19 21:14:16.658733 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 276/620] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:16 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:17.682371 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-19c8abbf-342c-40aa-99a7-a2940cd618cb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:17.683071 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-19c8abbf-342c-40aa-99a7-a2940cd618cb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:17.690130 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-19c8abbf-342c-40aa-99a7-a2940cd618cb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:17.690615 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-19c8abbf-342c-40aa-99a7-a2940cd618cb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:17.691046 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-19c8abbf-342c-40aa-99a7-a2940cd618cb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:17.691747 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-19c8abbf-342c-40aa-99a7-a2940cd618cb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:17.692196 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-19c8abbf-342c-40aa-99a7-a2940cd618cb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:17.692612 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-19c8abbf-342c-40aa-99a7-a2940cd618cb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:17.836536 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-19c8abbf-342c-40aa-99a7-a2940cd618cb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:17.844666 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-19c8abbf-342c-40aa-99a7-a2940cd618cb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1678 microversion: 2.1 time: 0.167599 Aug 19 21:14:17.845255 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 345/621] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:17 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:18.869283 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-c5a0a3e4-52fb-40ad-9f28-c8babaa45c43 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:18.869986 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-c5a0a3e4-52fb-40ad-9f28-c8babaa45c43 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:18.877949 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c5a0a3e4-52fb-40ad-9f28-c8babaa45c43 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:18.878502 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c5a0a3e4-52fb-40ad-9f28-c8babaa45c43 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:18.878956 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c5a0a3e4-52fb-40ad-9f28-c8babaa45c43 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:18.879652 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c5a0a3e4-52fb-40ad-9f28-c8babaa45c43 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:18.880101 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c5a0a3e4-52fb-40ad-9f28-c8babaa45c43 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:18.880691 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c5a0a3e4-52fb-40ad-9f28-c8babaa45c43 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:19.026244 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-c5a0a3e4-52fb-40ad-9f28-c8babaa45c43 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:19.036585 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-c5a0a3e4-52fb-40ad-9f28-c8babaa45c43 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1678 microversion: 2.1 time: 0.172427 Aug 19 21:14:19.037185 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 277/622] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:18 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:20.061239 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-4e6a4321-c56a-47c8-8c8e-4879d13cfe45 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:20.061882 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-4e6a4321-c56a-47c8-8c8e-4879d13cfe45 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:20.071035 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4e6a4321-c56a-47c8-8c8e-4879d13cfe45 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:20.071525 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4e6a4321-c56a-47c8-8c8e-4879d13cfe45 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:20.071958 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4e6a4321-c56a-47c8-8c8e-4879d13cfe45 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:20.072659 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4e6a4321-c56a-47c8-8c8e-4879d13cfe45 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:20.073107 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4e6a4321-c56a-47c8-8c8e-4879d13cfe45 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:20.073524 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4e6a4321-c56a-47c8-8c8e-4879d13cfe45 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:20.222439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-4e6a4321-c56a-47c8-8c8e-4879d13cfe45 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:20.231659 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-4e6a4321-c56a-47c8-8c8e-4879d13cfe45 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1678 microversion: 2.1 time: 0.174165 Aug 19 21:14:20.232253 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 346/623] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:20 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:21.255529 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-cece9d2b-9133-4599-a5e0-5404ae7eded8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:21.256507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-cece9d2b-9133-4599-a5e0-5404ae7eded8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:21.264329 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cece9d2b-9133-4599-a5e0-5404ae7eded8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:21.264820 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cece9d2b-9133-4599-a5e0-5404ae7eded8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:21.265255 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cece9d2b-9133-4599-a5e0-5404ae7eded8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:21.266004 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cece9d2b-9133-4599-a5e0-5404ae7eded8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:21.266456 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cece9d2b-9133-4599-a5e0-5404ae7eded8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:21.266877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cece9d2b-9133-4599-a5e0-5404ae7eded8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:21.413609 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-cece9d2b-9133-4599-a5e0-5404ae7eded8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:21.422562 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-cece9d2b-9133-4599-a5e0-5404ae7eded8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1678 microversion: 2.1 time: 0.171649 Aug 19 21:14:21.423188 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 278/624] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:21 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:22.455413 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a3bfc1c1-574d-4896-a179-b3d9a5dd5ad5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:22.456088 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-a3bfc1c1-574d-4896-a179-b3d9a5dd5ad5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:22.464492 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3bfc1c1-574d-4896-a179-b3d9a5dd5ad5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:22.465004 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3bfc1c1-574d-4896-a179-b3d9a5dd5ad5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:22.465447 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3bfc1c1-574d-4896-a179-b3d9a5dd5ad5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:22.466209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3bfc1c1-574d-4896-a179-b3d9a5dd5ad5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:22.466676 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3bfc1c1-574d-4896-a179-b3d9a5dd5ad5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:22.467105 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3bfc1c1-574d-4896-a179-b3d9a5dd5ad5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:22.622385 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-a3bfc1c1-574d-4896-a179-b3d9a5dd5ad5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:22.630900 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-a3bfc1c1-574d-4896-a179-b3d9a5dd5ad5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1678 microversion: 2.1 time: 0.179400 Aug 19 21:14:22.631499 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 347/625] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:22 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:14:23.654967 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-bc52842e-2cfc-49f9-8570-31db4b1ed2c0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:23.655521 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-bc52842e-2cfc-49f9-8570-31db4b1ed2c0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:23.658393 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=40 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:14:23.664426 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-bc52842e-2cfc-49f9-8570-31db4b1ed2c0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:23.664914 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-bc52842e-2cfc-49f9-8570-31db4b1ed2c0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:23.665350 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-bc52842e-2cfc-49f9-8570-31db4b1ed2c0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:23.666096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-bc52842e-2cfc-49f9-8570-31db4b1ed2c0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:23.666550 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-bc52842e-2cfc-49f9-8570-31db4b1ed2c0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:23.666971 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-bc52842e-2cfc-49f9-8570-31db4b1ed2c0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:23.814693 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-bc52842e-2cfc-49f9-8570-31db4b1ed2c0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:23.823203 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-bc52842e-2cfc-49f9-8570-31db4b1ed2c0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1678 microversion: 2.1 time: 0.172796 Aug 19 21:14:23.823794 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 279/626] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:23 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:24.849830 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ce8c8058-1a0b-4553-9138-1aec4709beb7 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:24.850440 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ce8c8058-1a0b-4553-9138-1aec4709beb7 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:24.858384 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce8c8058-1a0b-4553-9138-1aec4709beb7 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:24.858872 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce8c8058-1a0b-4553-9138-1aec4709beb7 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:24.859305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce8c8058-1a0b-4553-9138-1aec4709beb7 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:24.860015 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce8c8058-1a0b-4553-9138-1aec4709beb7 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:24.860468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce8c8058-1a0b-4553-9138-1aec4709beb7 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:24.860887 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce8c8058-1a0b-4553-9138-1aec4709beb7 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:25.016116 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ce8c8058-1a0b-4553-9138-1aec4709beb7 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:25.024624 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ce8c8058-1a0b-4553-9138-1aec4709beb7 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1678 microversion: 2.1 time: 0.178788 Aug 19 21:14:25.025483 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 348/627] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:24 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:26.047909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-ea3db306-5cae-4456-ba2a-5381672cb77b tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:26.048525 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-ea3db306-5cae-4456-ba2a-5381672cb77b tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:26.055560 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ea3db306-5cae-4456-ba2a-5381672cb77b tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:26.056060 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ea3db306-5cae-4456-ba2a-5381672cb77b tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:26.056492 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ea3db306-5cae-4456-ba2a-5381672cb77b tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:26.057198 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ea3db306-5cae-4456-ba2a-5381672cb77b tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:26.057642 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ea3db306-5cae-4456-ba2a-5381672cb77b tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:26.058103 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ea3db306-5cae-4456-ba2a-5381672cb77b tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:26.201782 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-ea3db306-5cae-4456-ba2a-5381672cb77b tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:26.211428 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-ea3db306-5cae-4456-ba2a-5381672cb77b tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1678 microversion: 2.1 time: 0.167695 Aug 19 21:14:26.212030 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 280/628] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:26 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:14:27.233061 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a5c78af0-d02e-4bdb-9852-2dcec352c6b0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:27.233664 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-a5c78af0-d02e-4bdb-9852-2dcec352c6b0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:27.240576 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a5c78af0-d02e-4bdb-9852-2dcec352c6b0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:27.241238 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a5c78af0-d02e-4bdb-9852-2dcec352c6b0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:27.242088 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a5c78af0-d02e-4bdb-9852-2dcec352c6b0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:27.242598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a5c78af0-d02e-4bdb-9852-2dcec352c6b0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:27.243228 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a5c78af0-d02e-4bdb-9852-2dcec352c6b0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:27.243693 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a5c78af0-d02e-4bdb-9852-2dcec352c6b0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:27.386745 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-a5c78af0-d02e-4bdb-9852-2dcec352c6b0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:27.394995 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-a5c78af0-d02e-4bdb-9852-2dcec352c6b0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1655 microversion: 2.1 time: 0.165653 Aug 19 21:14:27.395677 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 349/629] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:27 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1655 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:27.418811 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-472f4744-59eb-4817-8ef2-3211dc25f33e tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:14:27.425564 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-472f4744-59eb-4817-8ef2-3211dc25f33e tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:27.426083 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-472f4744-59eb-4817-8ef2-3211dc25f33e tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:27.426517 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-472f4744-59eb-4817-8ef2-3211dc25f33e tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:27.450802 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-472f4744-59eb-4817-8ef2-3211dc25f33e tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Going to try to start instance {{(pid=120876) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 19 21:14:27.498887 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-472f4744-59eb-4817-8ef2-3211dc25f33e tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "POST /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e/action" status: 202 len: 0 microversion: 2.1 time: 0.084279 Aug 19 21:14:27.499516 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 281/630] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Aug 19 21:14:27 2022] POST /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 19 21:14:27.513180 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-f2ddaee4-c0d5-4e6d-b973-b601589036b7 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:27.514309 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-f2ddaee4-c0d5-4e6d-b973-b601589036b7 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:27.525060 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f2ddaee4-c0d5-4e6d-b973-b601589036b7 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:27.525545 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f2ddaee4-c0d5-4e6d-b973-b601589036b7 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:27.526029 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f2ddaee4-c0d5-4e6d-b973-b601589036b7 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:27.526747 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f2ddaee4-c0d5-4e6d-b973-b601589036b7 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:27.527229 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f2ddaee4-c0d5-4e6d-b973-b601589036b7 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:27.527659 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f2ddaee4-c0d5-4e6d-b973-b601589036b7 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:27.728406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-f2ddaee4-c0d5-4e6d-b973-b601589036b7 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:27.737189 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-f2ddaee4-c0d5-4e6d-b973-b601589036b7 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1664 microversion: 2.1 time: 0.231407 Aug 19 21:14:27.737774 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 350/631] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:27 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1664 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:28.769601 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-5d41e531-d3d9-402b-a4f2-b4d6ba5472d2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:28.770473 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-5d41e531-d3d9-402b-a4f2-b4d6ba5472d2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:28.779017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5d41e531-d3d9-402b-a4f2-b4d6ba5472d2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:28.779507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5d41e531-d3d9-402b-a4f2-b4d6ba5472d2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:28.779951 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5d41e531-d3d9-402b-a4f2-b4d6ba5472d2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:28.780662 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5d41e531-d3d9-402b-a4f2-b4d6ba5472d2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:28.781116 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5d41e531-d3d9-402b-a4f2-b4d6ba5472d2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:28.781539 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5d41e531-d3d9-402b-a4f2-b4d6ba5472d2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:28.917987 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-5d41e531-d3d9-402b-a4f2-b4d6ba5472d2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:28.925727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-5d41e531-d3d9-402b-a4f2-b4d6ba5472d2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1664 microversion: 2.1 time: 0.170672 Aug 19 21:14:28.926397 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 282/632] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:28 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1664 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:29.947845 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-5942cab7-6890-4c45-9e56-4a3b8cf7247a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:29.948448 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-5942cab7-6890-4c45-9e56-4a3b8cf7247a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:29.954772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5942cab7-6890-4c45-9e56-4a3b8cf7247a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:29.955247 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5942cab7-6890-4c45-9e56-4a3b8cf7247a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:29.955676 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5942cab7-6890-4c45-9e56-4a3b8cf7247a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:29.956353 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5942cab7-6890-4c45-9e56-4a3b8cf7247a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:29.956802 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5942cab7-6890-4c45-9e56-4a3b8cf7247a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:29.957212 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5942cab7-6890-4c45-9e56-4a3b8cf7247a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:30.090241 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-5942cab7-6890-4c45-9e56-4a3b8cf7247a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:30.098220 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-5942cab7-6890-4c45-9e56-4a3b8cf7247a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1668 microversion: 2.1 time: 0.154322 Aug 19 21:14:30.098781 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 351/633] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:29 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:37.859029 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-97fdd9ae-dfc6-4dd2-a53e-87bae428624f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:37.859524 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-97fdd9ae-dfc6-4dd2-a53e-87bae428624f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:37.865463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-97fdd9ae-dfc6-4dd2-a53e-87bae428624f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:37.866024 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-97fdd9ae-dfc6-4dd2-a53e-87bae428624f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:37.866452 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-97fdd9ae-dfc6-4dd2-a53e-87bae428624f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:37.867137 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-97fdd9ae-dfc6-4dd2-a53e-87bae428624f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:37.867584 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-97fdd9ae-dfc6-4dd2-a53e-87bae428624f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:37.868001 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-97fdd9ae-dfc6-4dd2-a53e-87bae428624f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:37.871749 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:14:37.892734 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-97fdd9ae-dfc6-4dd2-a53e-87bae428624f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532/ips" status: 200 len: 149 microversion: 2.1 time: 0.141459 Aug 19 21:14:37.893294 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 283/634] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Aug 19 21:14:37 2022] GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532/ips => generated 149 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:14:37.905576 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-1306b149-2d81-4373-a93c-84314bf6ca4b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ff37e1e-37bb-480c-a9e3-cac7418d7084"}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:14:37.907985 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-1306b149-2d81-4373-a93c-84314bf6ca4b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:37.916614 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1306b149-2d81-4373-a93c-84314bf6ca4b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:37.918667 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1306b149-2d81-4373-a93c-84314bf6ca4b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:37.919125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1306b149-2d81-4373-a93c-84314bf6ca4b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:37.920690 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1306b149-2d81-4373-a93c-84314bf6ca4b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:37.921169 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1306b149-2d81-4373-a93c-84314bf6ca4b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:37.921603 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1306b149-2d81-4373-a93c-84314bf6ca4b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:37.924315 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:14:38.005368 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-1306b149-2d81-4373-a93c-84314bf6ca4b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] HTTP exception thrown: Invalid volume: volume 7ff37e1e-37bb-480c-a9e3-cac7418d7084 is already attached to instances: 99339e5a-af6a-4d00-a02b-cec028b663ae Aug 19 21:14:38.007458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-1306b149-2d81-4373-a93c-84314bf6ca4b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Request method failure captured: Aug 19 21:14:38.007458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: POST /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532/os-volume_attachments HTTP/1.1 Aug 19 21:14:38.007458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:14:38.007458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:14:38.007458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:14:38.007458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 74 Aug 19 21:14:38.007458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:14:38.007458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:14:38.007458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:14:38.007458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:14:38.007458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__vTnxy0ZuRvCXYQHvdPUOIQ6IB7Tloqeiky5Yoiyt0Vgpb02m5mw3a2DEvQ0XyB7szWj5fdMvWapGqmCGDv7CfrB3Py-zgdnjUuiEJx19vEpXywPa2SVjntZLwoFOFk2XhitOUTwaBJ37dbyUmN2puMJZysaOLWl8Nrh88xp2dULAg Aug 19 21:14:38.007458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:14:38.007458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:14:38.007458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:14:38.007458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:14:38.007458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:14:38.007458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:14:38.007458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:14:38.007458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:14:38.007458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:14:38.007458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:14:38.009125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:14:38.009125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:14:38.009125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:14:38.009125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:14:38.009125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:14:38.009125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:14:38.009125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:14:38.009125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: 7f46019e78cc4e89bf877a4f5a7a8fe9 Aug 19 21:14:38.009125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:14:38.009125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Aug 19 21:14:38.009125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {"volumeAttachment": {"volumeId": "7ff37e1e-37bb-480c-a9e3-cac7418d7084"}} Aug 19 21:14:38.009125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: > Aug 19 21:14:38.010197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Invalid volume: volume 7ff37e1e-37bb-480c-a9e3-cac7418d7084 is already attached to instances: 99339e5a-af6a-4d00-a02b-cec028b663ae Aug 19 21:14:38.010197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'server_id': 'ee12fef4-cda2-4500-9975-002853bd4532', 'body': {'volumeAttachment': {'volumeId': '7ff37e1e-37bb-480c-a9e3-cac7418d7084'}}} Aug 19 21:14:38.010197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:14:38.010197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:14:38.010197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 19 21:14:38.010197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 19 21:14:38.010197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 19 21:14:38.010197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 19 21:14:38.010197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 19 21:14:38.010197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 19 21:14:38.010197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5119, in attach_volume Aug 19 21:14:38.010197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 19 21:14:38.010197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4959, in _check_volume_already_attached Aug 19 21:14:38.010197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 19 21:14:38.010197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7ff37e1e-37bb-480c-a9e3-cac7418d7084 is already attached to instances: 99339e5a-af6a-4d00-a02b-cec028b663ae Aug 19 21:14:38.010197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:14:38.010197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:14:38.010197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:14:38.010197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:14:38.012002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:14:38.012002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:14:38.012002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:14:38.012002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:14:38.012002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:14:38.012002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:14:38.012002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 21:14:38.012002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 21:14:38.012002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 21:14:38.012002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 21:14:38.012002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 21:14:38.012002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 21:14:38.012002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 19 21:14:38.012002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 19 21:14:38.012002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7ff37e1e-37bb-480c-a9e3-cac7418d7084 is already attached to instances: 99339e5a-af6a-4d00-a02b-cec028b663ae Aug 19 21:14:38.012002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:14:38.012002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:14:38.012002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:14:38.012002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:14:38.012002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:14:38.013539 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:14:38.013539 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:14:38.013539 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:14:38.013539 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7ff37e1e-37bb-480c-a9e3-cac7418d7084 is already attached to instances: 99339e5a-af6a-4d00-a02b-cec028b663ae Aug 19 21:14:38.013539 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:14:38.013539 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-1306b149-2d81-4373-a93c-84314bf6ca4b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Returning 400 to user: Invalid volume: volume 7ff37e1e-37bb-480c-a9e3-cac7418d7084 is already attached to instances: 99339e5a-af6a-4d00-a02b-cec028b663ae {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:14:38.013539 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-1306b149-2d81-4373-a93c-84314bf6ca4b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "POST /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107310 Aug 19 21:14:38.013539 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 352/635] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Aug 19 21:14:37 2022] POST /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 19 21:14:38.019751 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-f25ee84f-4f7f-4e87-a1d0-afe87092c37b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:38.020239 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-f25ee84f-4f7f-4e87-a1d0-afe87092c37b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:38.026856 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f25ee84f-4f7f-4e87-a1d0-afe87092c37b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:38.027311 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f25ee84f-4f7f-4e87-a1d0-afe87092c37b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:38.027740 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f25ee84f-4f7f-4e87-a1d0-afe87092c37b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:38.028706 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f25ee84f-4f7f-4e87-a1d0-afe87092c37b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:38.029158 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f25ee84f-4f7f-4e87-a1d0-afe87092c37b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:38.029572 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f25ee84f-4f7f-4e87-a1d0-afe87092c37b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:38.056120 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-f25ee84f-4f7f-4e87-a1d0-afe87092c37b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] Going to try to terminate instance {{(pid=120876) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 21:14:38.132008 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-f25ee84f-4f7f-4e87-a1d0-afe87092c37b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532" status: 204 len: 0 microversion: 2.1 time: 0.116077 Aug 19 21:14:38.132757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 284/636] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:14:38 2022] DELETE /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 19 21:14:38.141306 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-00a46e87-908d-4e6a-895e-f2befbf4f5a1 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:38.142053 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-00a46e87-908d-4e6a-895e-f2befbf4f5a1 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:38.149336 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-00a46e87-908d-4e6a-895e-f2befbf4f5a1 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:38.149853 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-00a46e87-908d-4e6a-895e-f2befbf4f5a1 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:38.150269 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-00a46e87-908d-4e6a-895e-f2befbf4f5a1 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:38.150948 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-00a46e87-908d-4e6a-895e-f2befbf4f5a1 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:38.151396 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-00a46e87-908d-4e6a-895e-f2befbf4f5a1 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:38.151814 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-00a46e87-908d-4e6a-895e-f2befbf4f5a1 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:38.281702 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-00a46e87-908d-4e6a-895e-f2befbf4f5a1 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:38.290245 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-00a46e87-908d-4e6a-895e-f2befbf4f5a1 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532" status: 200 len: 1681 microversion: 2.1 time: 0.152811 Aug 19 21:14:38.290802 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 353/637] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:38 2022] GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:39.312096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-f81aba87-85ba-4544-96d2-de82dee96fb7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:39.312827 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-f81aba87-85ba-4544-96d2-de82dee96fb7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:39.320319 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f81aba87-85ba-4544-96d2-de82dee96fb7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:39.320993 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f81aba87-85ba-4544-96d2-de82dee96fb7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:39.321421 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f81aba87-85ba-4544-96d2-de82dee96fb7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:39.322171 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f81aba87-85ba-4544-96d2-de82dee96fb7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:39.322632 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f81aba87-85ba-4544-96d2-de82dee96fb7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:39.323035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f81aba87-85ba-4544-96d2-de82dee96fb7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:39.475740 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-f81aba87-85ba-4544-96d2-de82dee96fb7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:39.484094 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-f81aba87-85ba-4544-96d2-de82dee96fb7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532" status: 200 len: 1681 microversion: 2.1 time: 0.176277 Aug 19 21:14:39.484660 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 285/638] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:39 2022] GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:40.505212 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-51938c18-36af-4769-af25-d96c544cfb34 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:40.505947 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-51938c18-36af-4769-af25-d96c544cfb34 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:40.515625 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-51938c18-36af-4769-af25-d96c544cfb34 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:40.516312 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-51938c18-36af-4769-af25-d96c544cfb34 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:40.516790 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-51938c18-36af-4769-af25-d96c544cfb34 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:40.517544 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-51938c18-36af-4769-af25-d96c544cfb34 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:40.518171 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-51938c18-36af-4769-af25-d96c544cfb34 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:40.520039 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-51938c18-36af-4769-af25-d96c544cfb34 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:40.900267 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-51938c18-36af-4769-af25-d96c544cfb34 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:40.908494 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-51938c18-36af-4769-af25-d96c544cfb34 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532" status: 200 len: 1613 microversion: 2.1 time: 0.407290 Aug 19 21:14:40.909087 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 354/639] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:40 2022] GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532 => generated 1613 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:41.171745 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-4845eeb8-1949-431f-8654-10002fc2879b req-9fce49ec-4250-4e2a-9d8c-01abb8f029fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee12fef4-cda2-4500-9975-002853bd4532", "name": "network-vif-deleted", "tag": "1f2e766b-4dc3-43cb-ad33-5a377682a81e"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:14:41.183575 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-4845eeb8-1949-431f-8654-10002fc2879b req-9fce49ec-4250-4e2a-9d8c-01abb8f029fe service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:41.184339 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-4845eeb8-1949-431f-8654-10002fc2879b req-9fce49ec-4250-4e2a-9d8c-01abb8f029fe service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:41.184784 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-4845eeb8-1949-431f-8654-10002fc2879b req-9fce49ec-4250-4e2a-9d8c-01abb8f029fe service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:41.198221 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-4845eeb8-1949-431f-8654-10002fc2879b req-9fce49ec-4250-4e2a-9d8c-01abb8f029fe service nova] Creating event network-vif-deleted:1f2e766b-4dc3-43cb-ad33-5a377682a81e for instance ee12fef4-cda2-4500-9975-002853bd4532 on hv-cinder-85220 Aug 19 21:14:41.204033 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-4845eeb8-1949-431f-8654-10002fc2879b req-9fce49ec-4250-4e2a-9d8c-01abb8f029fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105157 Aug 19 21:14:41.205089 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 286/640] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:14:41.932066 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ca0eed51-669a-427c-affd-054e41af8865 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:41.932693 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ca0eed51-669a-427c-affd-054e41af8865 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:41.935578 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=26 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:14:41.941663 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ca0eed51-669a-427c-affd-054e41af8865 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:41.942188 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ca0eed51-669a-427c-affd-054e41af8865 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:41.942622 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ca0eed51-669a-427c-affd-054e41af8865 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:41.943355 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ca0eed51-669a-427c-affd-054e41af8865 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:41.943807 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ca0eed51-669a-427c-affd-054e41af8865 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:41.945002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ca0eed51-669a-427c-affd-054e41af8865 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:41.959217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-ca0eed51-669a-427c-affd-054e41af8865 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] HTTP exception thrown: Instance ee12fef4-cda2-4500-9975-002853bd4532 could not be found. Aug 19 21:14:41.961209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ca0eed51-669a-427c-affd-054e41af8865 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Request method failure captured: Aug 19 21:14:41.961209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532 HTTP/1.1 Aug 19 21:14:41.961209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:14:41.961209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:14:41.961209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:14:41.961209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:14:41.961209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:14:41.961209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:14:41.961209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:14:41.961209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:14:41.961209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__vTnxy0ZuRvCXYQHvdPUOIQ6IB7Tloqeiky5Yoiyt0Vgpb02m5mw3a2DEvQ0XyB7szWj5fdMvWapGqmCGDv7CfrB3Py-zgdnjUuiEJx19vEpXywPa2SVjntZLwoFOFk2XhitOUTwaBJ37dbyUmN2puMJZysaOLWl8Nrh88xp2dULAg Aug 19 21:14:41.961209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:14:41.961209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:14:41.961209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:14:41.961209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:14:41.961209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:14:41.961209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:14:41.961209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:14:41.961209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:14:41.961209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:14:41.961209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:14:41.962868 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:14:41.962868 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:14:41.962868 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:14:41.962868 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:14:41.962868 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:14:41.962868 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:14:41.962868 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:14:41.962868 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: 7f46019e78cc4e89bf877a4f5a7a8fe9 Aug 19 21:14:41.962868 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:14:41.962868 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: > Aug 19 21:14:41.962868 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Instance ee12fef4-cda2-4500-9975-002853bd4532 could not be found. Aug 19 21:14:41.962868 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'id': 'ee12fef4-cda2-4500-9975-002853bd4532'} Aug 19 21:14:41.963744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:14:41.963744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:14:41.963744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:14:41.963744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:14:41.963744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:14:41.963744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:14:41.963744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:14:41.963744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:14:41.963744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:14:41.963744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:14:41.963744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee12fef4-cda2-4500-9975-002853bd4532 could not be found. Aug 19 21:14:41.963744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:14:41.963744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:14:41.963744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:14:41.963744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:14:41.963744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:14:41.963744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:14:41.963744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:14:41.963744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:14:41.963744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:14:41.965153 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:14:41.965153 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:14:41.965153 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:14:41.965153 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:14:41.965153 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:14:41.965153 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:14:41.965153 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:14:41.965153 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee12fef4-cda2-4500-9975-002853bd4532 could not be found. Aug 19 21:14:41.965153 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:14:41.965153 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:14:41.965153 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:14:41.965153 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:14:41.965153 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:14:41.965153 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:14:41.965153 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:14:41.965153 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:14:41.965153 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee12fef4-cda2-4500-9975-002853bd4532 could not be found. Aug 19 21:14:41.965153 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:14:41.967137 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ca0eed51-669a-427c-affd-054e41af8865 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Returning 404 to user: Instance ee12fef4-cda2-4500-9975-002853bd4532 could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:14:41.968015 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ca0eed51-669a-427c-affd-054e41af8865 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532" status: 404 len: 111 microversion: 2.1 time: 0.041427 Aug 19 21:14:41.968571 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 355/641] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:41 2022] GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:14:41.977942 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-66ac5dce-a295-4de8-a112-c030b5281593 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '.version_select at 0x7f740bd195e0>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:41.982863 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR oslo.messaging._drivers.impl_rabbit [None req-66ac5dce-a295-4de8-a112-c030b5281593 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [25fd6f07-08c0-4a29-b345-c7cad46fbe41] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 19 21:14:42.991994 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO oslo.messaging._drivers.impl_rabbit [None req-66ac5dce-a295-4de8-a112-c030b5281593 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [25fd6f07-08c0-4a29-b345-c7cad46fbe41] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 58738. Aug 19 21:14:43.010899 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-66ac5dce-a295-4de8-a112-c030b5281593 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-612838023" status: 202 len: 0 microversion: 2.1 time: 1.037484 Aug 19 21:14:43.011730 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 287/642] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Aug 19 21:14:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-612838023 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:14:43.690717 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3b0b3da7-c631-49e1-ae24-094586cadeb7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:43.691277 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-3b0b3da7-c631-49e1-ae24-094586cadeb7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:43.698112 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3b0b3da7-c631-49e1-ae24-094586cadeb7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:43.698610 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3b0b3da7-c631-49e1-ae24-094586cadeb7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:43.699044 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3b0b3da7-c631-49e1-ae24-094586cadeb7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:43.699807 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3b0b3da7-c631-49e1-ae24-094586cadeb7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:43.700259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3b0b3da7-c631-49e1-ae24-094586cadeb7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:43.700679 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3b0b3da7-c631-49e1-ae24-094586cadeb7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:43.786213 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.objects.instance [None req-3b0b3da7-c631-49e1-ae24-094586cadeb7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lazy-loading 'services' on Instance uuid 99339e5a-af6a-4d00-a02b-cec028b663ae {{(pid=120877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:14:43.903404 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-3b0b3da7-c631-49e1-ae24-094586cadeb7 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "DELETE /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae/os-volume_attachments/7ff37e1e-37bb-480c-a9e3-cac7418d7084" status: 202 len: 0 microversion: 2.1 time: 0.216484 Aug 19 21:14:43.904074 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 356/643] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Aug 19 21:14:43 2022] DELETE /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae/os-volume_attachments/7ff37e1e-37bb-480c-a9e3-cac7418d7084 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:14:43.914365 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-71603ca2-408f-4fc7-964b-acd438f54da2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:43.917159 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-71603ca2-408f-4fc7-964b-acd438f54da2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:43.923750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71603ca2-408f-4fc7-964b-acd438f54da2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:43.924370 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71603ca2-408f-4fc7-964b-acd438f54da2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:43.924832 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71603ca2-408f-4fc7-964b-acd438f54da2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:43.925637 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71603ca2-408f-4fc7-964b-acd438f54da2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:43.926346 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71603ca2-408f-4fc7-964b-acd438f54da2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:43.926773 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71603ca2-408f-4fc7-964b-acd438f54da2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:43.961060 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-71603ca2-408f-4fc7-964b-acd438f54da2 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051678 Aug 19 21:14:43.962114 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 288/644] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Aug 19 21:14:43 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:14:44.975333 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-14bf9dcd-21a6-441f-84ab-e21713825a61 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:44.978894 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-14bf9dcd-21a6-441f-84ab-e21713825a61 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:44.985253 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-14bf9dcd-21a6-441f-84ab-e21713825a61 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:44.985717 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-14bf9dcd-21a6-441f-84ab-e21713825a61 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:44.986177 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-14bf9dcd-21a6-441f-84ab-e21713825a61 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:44.986867 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-14bf9dcd-21a6-441f-84ab-e21713825a61 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:44.987312 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-14bf9dcd-21a6-441f-84ab-e21713825a61 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:44.987731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-14bf9dcd-21a6-441f-84ab-e21713825a61 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:45.018160 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-14bf9dcd-21a6-441f-84ab-e21713825a61 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047672 Aug 19 21:14:45.018701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 357/645] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Aug 19 21:14:44 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 21:14:45.080250 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-76fd88d4-b604-4df4-b8e2-794b41263d08 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:45.080761 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-76fd88d4-b604-4df4-b8e2-794b41263d08 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:45.087886 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-76fd88d4-b604-4df4-b8e2-794b41263d08 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:45.088367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-76fd88d4-b604-4df4-b8e2-794b41263d08 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:45.088798 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-76fd88d4-b604-4df4-b8e2-794b41263d08 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:45.089704 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-76fd88d4-b604-4df4-b8e2-794b41263d08 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:45.089969 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-76fd88d4-b604-4df4-b8e2-794b41263d08 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:45.090400 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-76fd88d4-b604-4df4-b8e2-794b41263d08 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:45.115617 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-76fd88d4-b604-4df4-b8e2-794b41263d08 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Going to try to terminate instance {{(pid=120876) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 21:14:45.191605 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-76fd88d4-b604-4df4-b8e2-794b41263d08 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "DELETE /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 204 len: 0 microversion: 2.1 time: 0.114875 Aug 19 21:14:45.192292 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 289/646] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:14:45 2022] DELETE /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 21:14:45.201902 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-71765e8b-0c8b-4b83-a8e1-f3695d6800eb tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:45.202559 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-71765e8b-0c8b-4b83-a8e1-f3695d6800eb tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:45.208666 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-71765e8b-0c8b-4b83-a8e1-f3695d6800eb tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:45.209157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-71765e8b-0c8b-4b83-a8e1-f3695d6800eb tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:45.209652 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-71765e8b-0c8b-4b83-a8e1-f3695d6800eb tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:45.210921 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-71765e8b-0c8b-4b83-a8e1-f3695d6800eb tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:45.211381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-71765e8b-0c8b-4b83-a8e1-f3695d6800eb tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:45.211809 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-71765e8b-0c8b-4b83-a8e1-f3695d6800eb tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:45.341975 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-71765e8b-0c8b-4b83-a8e1-f3695d6800eb tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:45.349633 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-71765e8b-0c8b-4b83-a8e1-f3695d6800eb tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1681 microversion: 2.1 time: 0.151753 Aug 19 21:14:45.350791 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 358/647] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:45 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:46.371643 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d30e72cf-8e60-4c1c-bb39-fa9deb6e78e5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:46.372408 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-d30e72cf-8e60-4c1c-bb39-fa9deb6e78e5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:46.379027 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d30e72cf-8e60-4c1c-bb39-fa9deb6e78e5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:46.379507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d30e72cf-8e60-4c1c-bb39-fa9deb6e78e5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:46.379929 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d30e72cf-8e60-4c1c-bb39-fa9deb6e78e5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:46.380805 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d30e72cf-8e60-4c1c-bb39-fa9deb6e78e5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:46.381245 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d30e72cf-8e60-4c1c-bb39-fa9deb6e78e5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:46.381881 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d30e72cf-8e60-4c1c-bb39-fa9deb6e78e5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:46.617151 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-d30e72cf-8e60-4c1c-bb39-fa9deb6e78e5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:46.625343 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-d30e72cf-8e60-4c1c-bb39-fa9deb6e78e5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 200 len: 1681 microversion: 2.1 time: 0.258661 Aug 19 21:14:46.625959 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 290/648] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:46 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 1681 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:47.053389 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-302fffb7-3d04-4883-a966-9b9ae596942d req-20d491ee-441b-4aba-a5da-498298d2c2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99339e5a-af6a-4d00-a02b-cec028b663ae", "name": "network-vif-deleted", "tag": "31356ae8-39a1-429f-bfe4-d7a38947ed9f"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:14:47.075710 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-302fffb7-3d04-4883-a966-9b9ae596942d req-20d491ee-441b-4aba-a5da-498298d2c2a1 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:47.076362 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-302fffb7-3d04-4883-a966-9b9ae596942d req-20d491ee-441b-4aba-a5da-498298d2c2a1 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:47.076806 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-302fffb7-3d04-4883-a966-9b9ae596942d req-20d491ee-441b-4aba-a5da-498298d2c2a1 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:47.090208 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-302fffb7-3d04-4883-a966-9b9ae596942d req-20d491ee-441b-4aba-a5da-498298d2c2a1 service nova] Creating event network-vif-deleted:31356ae8-39a1-429f-bfe4-d7a38947ed9f for instance 99339e5a-af6a-4d00-a02b-cec028b663ae on hv-cinder-85220 Aug 19 21:14:47.095145 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-302fffb7-3d04-4883-a966-9b9ae596942d req-20d491ee-441b-4aba-a5da-498298d2c2a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045374 Aug 19 21:14:47.095958 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 359/649] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:14:47.647660 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d08df2cf-7406-484c-9797-1ab17853e96e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:47.648561 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-d08df2cf-7406-484c-9797-1ab17853e96e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:47.654837 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d08df2cf-7406-484c-9797-1ab17853e96e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:47.655371 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d08df2cf-7406-484c-9797-1ab17853e96e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:47.656271 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d08df2cf-7406-484c-9797-1ab17853e96e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:47.657275 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d08df2cf-7406-484c-9797-1ab17853e96e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:47.657992 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d08df2cf-7406-484c-9797-1ab17853e96e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:47.658596 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d08df2cf-7406-484c-9797-1ab17853e96e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:47.673617 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-d08df2cf-7406-484c-9797-1ab17853e96e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] HTTP exception thrown: Instance 99339e5a-af6a-4d00-a02b-cec028b663ae could not be found. Aug 19 21:14:47.675333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d08df2cf-7406-484c-9797-1ab17853e96e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Request method failure captured: Aug 19 21:14:47.675333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae HTTP/1.1 Aug 19 21:14:47.675333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:14:47.675333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:14:47.675333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:14:47.675333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:14:47.675333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:14:47.675333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:14:47.675333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:14:47.675333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:14:47.675333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__vTnxy0ZuRvCXYQHvdPUOIQ6IB7Tloqeiky5Yoiyt0Vgpb02m5mw3a2DEvQ0XyB7szWj5fdMvWapGqmCGDv7CfrB3Py-zgdnjUuiEJx19vEpXywPa2SVjntZLwoFOFk2XhitOUTwaBJ37dbyUmN2puMJZysaOLWl8Nrh88xp2dULAg Aug 19 21:14:47.675333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:14:47.675333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:14:47.675333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:14:47.675333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:14:47.675333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:14:47.675333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:14:47.675333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:14:47.675333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:14:47.675333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:14:47.675333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:14:47.677073 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:14:47.677073 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:14:47.677073 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:14:47.677073 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:14:47.677073 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:14:47.677073 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:14:47.677073 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:14:47.677073 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: 7f46019e78cc4e89bf877a4f5a7a8fe9 Aug 19 21:14:47.677073 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:14:47.677073 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: > Aug 19 21:14:47.677073 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Instance 99339e5a-af6a-4d00-a02b-cec028b663ae could not be found. Aug 19 21:14:47.677073 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': '99339e5a-af6a-4d00-a02b-cec028b663ae'} Aug 19 21:14:47.677891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:14:47.677891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:14:47.677891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:14:47.677891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:14:47.677891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:14:47.677891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:14:47.677891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:14:47.677891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:14:47.677891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:14:47.677891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:14:47.677891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99339e5a-af6a-4d00-a02b-cec028b663ae could not be found. Aug 19 21:14:47.677891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:14:47.677891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:14:47.677891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:14:47.677891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:14:47.677891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:14:47.677891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:14:47.677891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:14:47.677891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:14:47.677891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:14:47.679750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:14:47.679750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:14:47.679750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:14:47.679750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:14:47.679750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:14:47.679750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:14:47.679750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:14:47.679750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99339e5a-af6a-4d00-a02b-cec028b663ae could not be found. Aug 19 21:14:47.679750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:14:47.679750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:14:47.679750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:14:47.679750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:14:47.679750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:14:47.679750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:14:47.679750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:14:47.679750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:14:47.679750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99339e5a-af6a-4d00-a02b-cec028b663ae could not be found. Aug 19 21:14:47.679750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:14:47.680826 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d08df2cf-7406-484c-9797-1ab17853e96e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Returning 404 to user: Instance 99339e5a-af6a-4d00-a02b-cec028b663ae could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:14:47.680826 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-d08df2cf-7406-484c-9797-1ab17853e96e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 404 len: 111 microversion: 2.1 time: 0.033158 Aug 19 21:14:47.680826 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 291/650] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:47 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 19 21:14:47.687699 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-7b8475fe-659a-481f-af4e-14b585b38387 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '.version_select at 0x7f740bc113a0>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:47.712700 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-7b8475fe-659a-481f-af4e-14b585b38387 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1232465057" status: 202 len: 0 microversion: 2.1 time: 0.029185 Aug 19 21:14:47.713285 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 360/651] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Aug 19 21:14:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1232465057 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:14:48.380525 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-594082ed-6d85-4075-bade-82da01fbc7d5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Action: 'create', calling method: .version_select at 0x7f740bc7ec10>, body: {"keypair": {"name": "tempest-keypair-1458425416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzbLO0avhPRSxZt9fV8ttQD4yIbapOxFeBLllwppFuPDonjZBy5hFEunrW0nQ3+Zjaq94KNhh7cmAMNmv5sfd+N1PVQ1nuUqxLXCb954d6nKipsFOtrG3XKwUPxeyxUmQ=="}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:14:48.396412 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-594082ed-6d85-4075-bade-82da01fbc7d5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Getting quotas for project 358e50f9b9df43b7aa0a4ba1353e4a25. Resources: {'key_pairs'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:14:48.400823 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-594082ed-6d85-4075-bade-82da01fbc7d5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Getting quotas for user 7f46019e78cc4e89bf877a4f5a7a8fe9 and project 358e50f9b9df43b7aa0a4ba1353e4a25. Resources: {'key_pairs'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:14:48.431912 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-594082ed-6d85-4075-bade-82da01fbc7d5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053301 Aug 19 21:14:48.431912 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 292/652] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Aug 19 21:14:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:14:49.682428 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e11b76b0-5d58-4abc-9e56-a4fe197ad4dd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1307063178", "imageRef": "d1f034cf-f103-477b-bbb5-3298c678db05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b0fd483-0b8c-45b1-8b1c-2c76848b5463"}], "security_groups": [{"name": "tempest-securitygroup--572105944"}], "key_name": "tempest-keypair-1458425416", "user_data": "}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:14:49.792600 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.network.neutron [None req-e11b76b0-5d58-4abc-9e56-a4fe197ad4dd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] validate_networks() for [('8b0fd483-0b8c-45b1-8b1c-2c76848b5463', None, None, None, None, None)] {{(pid=120877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 21:14:50.265332 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-e11b76b0-5d58-4abc-9e56-a4fe197ad4dd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Flavor limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 21:14:50.265801 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-e11b76b0-5d58-4abc-9e56-a4fe197ad4dd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Image limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 21:14:50.266281 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-e11b76b0-5d58-4abc-9e56-a4fe197ad4dd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Flavor pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 21:14:50.266689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-e11b76b0-5d58-4abc-9e56-a4fe197ad4dd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Image pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 21:14:50.267130 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-e11b76b0-5d58-4abc-9e56-a4fe197ad4dd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 21:14:50.276665 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e11b76b0-5d58-4abc-9e56-a4fe197ad4dd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:50.277146 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e11b76b0-5d58-4abc-9e56-a4fe197ad4dd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:50.277620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e11b76b0-5d58-4abc-9e56-a4fe197ad4dd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:50.278386 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e11b76b0-5d58-4abc-9e56-a4fe197ad4dd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:50.278840 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e11b76b0-5d58-4abc-9e56-a4fe197ad4dd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:50.279269 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e11b76b0-5d58-4abc-9e56-a4fe197ad4dd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:50.296787 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-e11b76b0-5d58-4abc-9e56-a4fe197ad4dd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Getting quotas for project 358e50f9b9df43b7aa0a4ba1353e4a25. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:14:50.300713 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-e11b76b0-5d58-4abc-9e56-a4fe197ad4dd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Getting quotas for user 7f46019e78cc4e89bf877a4f5a7a8fe9 and project 358e50f9b9df43b7aa0a4ba1353e4a25. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:14:50.311802 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-e11b76b0-5d58-4abc-9e56-a4fe197ad4dd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Going to run 1 instances... {{(pid=120877) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 21:14:50.314230 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-e11b76b0-5d58-4abc-9e56-a4fe197ad4dd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f034cf-f103-477b-bbb5-3298c678db05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 21:14:50.362083 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e11b76b0-5d58-4abc-9e56-a4fe197ad4dd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.684220 Aug 19 21:14:50.362819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 361/653] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Aug 19 21:14:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 21:14:50.374086 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-dd22e34a-e3cb-49e9-bb72-39e270f832dc tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:50.374707 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-dd22e34a-e3cb-49e9-bb72-39e270f832dc tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:50.433783 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-dd22e34a-e3cb-49e9-bb72-39e270f832dc tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:50.440688 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-dd22e34a-e3cb-49e9-bb72-39e270f832dc tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f" status: 200 len: 1242 microversion: 2.1 time: 0.070886 Aug 19 21:14:50.441267 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 293/654] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:50 2022] GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:51.463403 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-60438998-0619-4959-8713-ca45a99aec73 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:51.464116 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-60438998-0619-4959-8713-ca45a99aec73 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:51.471302 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-60438998-0619-4959-8713-ca45a99aec73 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:51.471839 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-60438998-0619-4959-8713-ca45a99aec73 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:51.472311 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-60438998-0619-4959-8713-ca45a99aec73 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:51.473391 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-60438998-0619-4959-8713-ca45a99aec73 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:51.474030 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-60438998-0619-4959-8713-ca45a99aec73 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:51.474429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-60438998-0619-4959-8713-ca45a99aec73 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:51.577198 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-60438998-0619-4959-8713-ca45a99aec73 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:51.586186 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-60438998-0619-4959-8713-ca45a99aec73 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f" status: 200 len: 1302 microversion: 2.1 time: 0.127570 Aug 19 21:14:51.599823 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 362/655] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:51 2022] GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f => generated 1302 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:52.505754 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-eefebee1-af4b-45fb-991b-f9c67efdb989 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:52.507184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-eefebee1-af4b-45fb-991b-f9c67efdb989 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:52.515069 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-eefebee1-af4b-45fb-991b-f9c67efdb989 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:52.515816 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-eefebee1-af4b-45fb-991b-f9c67efdb989 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:52.516433 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-eefebee1-af4b-45fb-991b-f9c67efdb989 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:52.517592 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-eefebee1-af4b-45fb-991b-f9c67efdb989 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:52.518246 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-eefebee1-af4b-45fb-991b-f9c67efdb989 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:52.518669 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-eefebee1-af4b-45fb-991b-f9c67efdb989 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:52.556319 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-eefebee1-af4b-45fb-991b-f9c67efdb989 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2/os-volume_attachments/9cd91dd9-d5cf-4a17-9f3e-35f1d8f57d76" status: 200 len: 194 microversion: 2.20 time: 0.054358 Aug 19 21:14:52.562672 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 294/656] 10.222.0.16 () {60 vars in 1454 bytes} [Fri Aug 19 21:14:52 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2/os-volume_attachments/9cd91dd9-d5cf-4a17-9f3e-35f1d8f57d76 => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 21:14:52.609345 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c07d7928-3126-484a-8477-03ad9867b444 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:52.610117 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-c07d7928-3126-484a-8477-03ad9867b444 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:52.626139 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c07d7928-3126-484a-8477-03ad9867b444 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:52.626139 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c07d7928-3126-484a-8477-03ad9867b444 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:52.626139 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c07d7928-3126-484a-8477-03ad9867b444 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:52.626139 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c07d7928-3126-484a-8477-03ad9867b444 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:52.626529 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c07d7928-3126-484a-8477-03ad9867b444 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:52.626888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c07d7928-3126-484a-8477-03ad9867b444 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:52.638158 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-25b09f01-306e-40c6-9c5b-4dbabd61f66a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:52.638992 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-25b09f01-306e-40c6-9c5b-4dbabd61f66a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:52.649074 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-25b09f01-306e-40c6-9c5b-4dbabd61f66a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:52.650083 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-25b09f01-306e-40c6-9c5b-4dbabd61f66a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:52.650517 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-25b09f01-306e-40c6-9c5b-4dbabd61f66a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:52.651230 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-25b09f01-306e-40c6-9c5b-4dbabd61f66a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:52.651837 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-25b09f01-306e-40c6-9c5b-4dbabd61f66a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:52.652407 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-25b09f01-306e-40c6-9c5b-4dbabd61f66a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:52.742499 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.objects.instance [None req-25b09f01-306e-40c6-9c5b-4dbabd61f66a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lazy-loading 'services' on Instance uuid f95c060a-e4cc-436c-a185-9345fd2c44f2 {{(pid=120876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:14:52.819649 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-25b09f01-306e-40c6-9c5b-4dbabd61f66a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2/os-volume_attachments/9cd91dd9-d5cf-4a17-9f3e-35f1d8f57d76" status: 202 len: 0 microversion: 2.20 time: 0.186533 Aug 19 21:14:52.820191 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 295/657] 10.222.0.16 () {60 vars in 1457 bytes} [Fri Aug 19 21:14:52 2022] DELETE /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2/os-volume_attachments/9cd91dd9-d5cf-4a17-9f3e-35f1d8f57d76 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 19 21:14:52.829114 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-7f8c312f-fbb6-4393-8870-057f9070e843 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:52.831459 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-7f8c312f-fbb6-4393-8870-057f9070e843 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:52.838045 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7f8c312f-fbb6-4393-8870-057f9070e843 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:52.838503 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7f8c312f-fbb6-4393-8870-057f9070e843 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:52.839185 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7f8c312f-fbb6-4393-8870-057f9070e843 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:52.839879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7f8c312f-fbb6-4393-8870-057f9070e843 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:52.840387 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7f8c312f-fbb6-4393-8870-057f9070e843 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:52.840881 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7f8c312f-fbb6-4393-8870-057f9070e843 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:52.864676 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c07d7928-3126-484a-8477-03ad9867b444 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:52.876042 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-c07d7928-3126-484a-8477-03ad9867b444 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f" status: 200 len: 1367 microversion: 2.1 time: 0.271852 Aug 19 21:14:52.890919 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 363/658] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:52 2022] GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:52.891655 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-7f8c312f-fbb6-4393-8870-057f9070e843 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056075 Aug 19 21:14:52.891655 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 296/659] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Aug 19 21:14:52 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 21:14:53.112361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-d0da7545-ef0b-4175-add0-8407333d48dd req-26daf432-0237-4f4c-b19c-7c6ae242f742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26867181-b826-417c-a967-774b70a8d82f", "tag": "59d9bc76-b59c-49ce-867d-9117c6cdb516"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:14:53.122748 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-d0da7545-ef0b-4175-add0-8407333d48dd req-26daf432-0237-4f4c-b19c-7c6ae242f742 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:53.123210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-d0da7545-ef0b-4175-add0-8407333d48dd req-26daf432-0237-4f4c-b19c-7c6ae242f742 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:53.123626 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-d0da7545-ef0b-4175-add0-8407333d48dd req-26daf432-0237-4f4c-b19c-7c6ae242f742 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:53.135810 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-d0da7545-ef0b-4175-add0-8407333d48dd req-26daf432-0237-4f4c-b19c-7c6ae242f742 service nova] Creating event network-changed:59d9bc76-b59c-49ce-867d-9117c6cdb516 for instance 26867181-b826-417c-a967-774b70a8d82f on hv-cinder-85220 Aug 19 21:14:53.141673 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-d0da7545-ef0b-4175-add0-8407333d48dd req-26daf432-0237-4f4c-b19c-7c6ae242f742 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032679 Aug 19 21:14:53.142180 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 364/660] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:14:53.892934 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-933149bf-5f46-436f-aa69-d03f496d4500 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:53.895170 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-933149bf-5f46-436f-aa69-d03f496d4500 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:53.897644 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:14:53.900251 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-1c40cdc1-d977-4c36-b029-72f5895da5ac tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:53.901551 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-1c40cdc1-d977-4c36-b029-72f5895da5ac tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:53.904576 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-933149bf-5f46-436f-aa69-d03f496d4500 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:53.905001 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-933149bf-5f46-436f-aa69-d03f496d4500 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:53.905428 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-933149bf-5f46-436f-aa69-d03f496d4500 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:53.906173 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-933149bf-5f46-436f-aa69-d03f496d4500 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:53.906622 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-933149bf-5f46-436f-aa69-d03f496d4500 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:53.907107 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-933149bf-5f46-436f-aa69-d03f496d4500 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:53.908812 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1c40cdc1-d977-4c36-b029-72f5895da5ac tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:53.909369 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1c40cdc1-d977-4c36-b029-72f5895da5ac tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:53.909877 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1c40cdc1-d977-4c36-b029-72f5895da5ac tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:53.910609 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1c40cdc1-d977-4c36-b029-72f5895da5ac tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:53.911151 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1c40cdc1-d977-4c36-b029-72f5895da5ac tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:53.911752 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1c40cdc1-d977-4c36-b029-72f5895da5ac tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:53.941495 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-933149bf-5f46-436f-aa69-d03f496d4500 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052529 Aug 19 21:14:53.942101 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 297/661] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Aug 19 21:14:53 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:14:54.010993 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-562dc5e7-0350-4220-9aa8-eb522dffeade tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:54.011827 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-562dc5e7-0350-4220-9aa8-eb522dffeade tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:54.017627 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-562dc5e7-0350-4220-9aa8-eb522dffeade tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:54.018389 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-562dc5e7-0350-4220-9aa8-eb522dffeade tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:54.018601 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-562dc5e7-0350-4220-9aa8-eb522dffeade tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:54.019287 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-562dc5e7-0350-4220-9aa8-eb522dffeade tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:54.019736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-562dc5e7-0350-4220-9aa8-eb522dffeade tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:54.020151 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-562dc5e7-0350-4220-9aa8-eb522dffeade tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:54.054924 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-562dc5e7-0350-4220-9aa8-eb522dffeade tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Going to try to terminate instance {{(pid=120876) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 21:14:54.075470 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-1c40cdc1-d977-4c36-b029-72f5895da5ac tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:54.083082 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-1c40cdc1-d977-4c36-b029-72f5895da5ac tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f" status: 200 len: 1367 microversion: 2.1 time: 0.187712 Aug 19 21:14:54.094475 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 365/662] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:53 2022] GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:14:54.110726 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:14:54.139193 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-562dc5e7-0350-4220-9aa8-eb522dffeade tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 204 len: 0 microversion: 2.20 time: 0.132890 Aug 19 21:14:54.139803 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 298/663] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Aug 19 21:14:54 2022] DELETE /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 19 21:14:54.148771 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-6fe7d5e1-799d-4e2b-a5c8-735f4ca3d955 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:54.149338 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-6fe7d5e1-799d-4e2b-a5c8-735f4ca3d955 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:54.155314 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6fe7d5e1-799d-4e2b-a5c8-735f4ca3d955 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:54.155790 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6fe7d5e1-799d-4e2b-a5c8-735f4ca3d955 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:54.156284 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6fe7d5e1-799d-4e2b-a5c8-735f4ca3d955 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:54.156894 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6fe7d5e1-799d-4e2b-a5c8-735f4ca3d955 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:54.157338 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6fe7d5e1-799d-4e2b-a5c8-735f4ca3d955 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:54.157752 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6fe7d5e1-799d-4e2b-a5c8-735f4ca3d955 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:54.293053 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-6fe7d5e1-799d-4e2b-a5c8-735f4ca3d955 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:54.301369 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-6fe7d5e1-799d-4e2b-a5c8-735f4ca3d955 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:54.302930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-6fe7d5e1-799d-4e2b-a5c8-735f4ca3d955 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:54.304713 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-6fe7d5e1-799d-4e2b-a5c8-735f4ca3d955 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1722 microversion: 2.20 time: 0.160431 Aug 19 21:14:54.305271 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 366/664] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:14:54 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:14:55.105282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d5f7fa2d-ad61-4501-babb-2bf9daec9294 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:55.106092 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-d5f7fa2d-ad61-4501-babb-2bf9daec9294 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:55.112544 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d5f7fa2d-ad61-4501-babb-2bf9daec9294 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:55.113018 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d5f7fa2d-ad61-4501-babb-2bf9daec9294 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:55.113445 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d5f7fa2d-ad61-4501-babb-2bf9daec9294 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:55.114166 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d5f7fa2d-ad61-4501-babb-2bf9daec9294 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:55.114618 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d5f7fa2d-ad61-4501-babb-2bf9daec9294 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:55.115036 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d5f7fa2d-ad61-4501-babb-2bf9daec9294 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:55.243850 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-d5f7fa2d-ad61-4501-babb-2bf9daec9294 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:55.251519 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-d5f7fa2d-ad61-4501-babb-2bf9daec9294 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f" status: 200 len: 1367 microversion: 2.1 time: 0.150611 Aug 19 21:14:55.252085 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 299/665] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:55 2022] GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:55.327446 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-810891cd-48c8-4c15-ab77-9dc260636282 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:55.328047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-810891cd-48c8-4c15-ab77-9dc260636282 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:55.335561 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-810891cd-48c8-4c15-ab77-9dc260636282 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:55.336049 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-810891cd-48c8-4c15-ab77-9dc260636282 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:55.336485 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-810891cd-48c8-4c15-ab77-9dc260636282 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:55.337175 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-810891cd-48c8-4c15-ab77-9dc260636282 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:55.337622 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-810891cd-48c8-4c15-ab77-9dc260636282 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:55.338064 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-810891cd-48c8-4c15-ab77-9dc260636282 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:55.467499 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-810891cd-48c8-4c15-ab77-9dc260636282 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:55.475877 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-810891cd-48c8-4c15-ab77-9dc260636282 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:55.477376 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-810891cd-48c8-4c15-ab77-9dc260636282 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:55.478545 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-810891cd-48c8-4c15-ab77-9dc260636282 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1722 microversion: 2.20 time: 0.154962 Aug 19 21:14:55.479100 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 367/666] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:14:55 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:14:56.273064 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d29bfa6b-27e7-4d90-a6f2-bb6aa9df3dc8 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:56.273684 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-d29bfa6b-27e7-4d90-a6f2-bb6aa9df3dc8 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:56.280175 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d29bfa6b-27e7-4d90-a6f2-bb6aa9df3dc8 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:56.280648 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d29bfa6b-27e7-4d90-a6f2-bb6aa9df3dc8 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:56.281070 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d29bfa6b-27e7-4d90-a6f2-bb6aa9df3dc8 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:56.281752 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d29bfa6b-27e7-4d90-a6f2-bb6aa9df3dc8 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:56.282224 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d29bfa6b-27e7-4d90-a6f2-bb6aa9df3dc8 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:56.282635 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d29bfa6b-27e7-4d90-a6f2-bb6aa9df3dc8 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:56.414399 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-d29bfa6b-27e7-4d90-a6f2-bb6aa9df3dc8 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:56.422791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-d29bfa6b-27e7-4d90-a6f2-bb6aa9df3dc8 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f" status: 200 len: 1367 microversion: 2.1 time: 0.153743 Aug 19 21:14:56.423760 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 300/667] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:56 2022] GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:56.502245 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c61846dd-7b17-4fad-80f8-a86b997c1cef tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:56.502848 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-c61846dd-7b17-4fad-80f8-a86b997c1cef tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:56.510570 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c61846dd-7b17-4fad-80f8-a86b997c1cef tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:56.511051 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c61846dd-7b17-4fad-80f8-a86b997c1cef tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:56.511479 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c61846dd-7b17-4fad-80f8-a86b997c1cef tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:56.512414 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c61846dd-7b17-4fad-80f8-a86b997c1cef tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:56.512859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c61846dd-7b17-4fad-80f8-a86b997c1cef tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:56.513273 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c61846dd-7b17-4fad-80f8-a86b997c1cef tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:56.644027 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c61846dd-7b17-4fad-80f8-a86b997c1cef tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:56.652794 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c61846dd-7b17-4fad-80f8-a86b997c1cef tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:56.654372 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c61846dd-7b17-4fad-80f8-a86b997c1cef tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:56.655468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-c61846dd-7b17-4fad-80f8-a86b997c1cef tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1722 microversion: 2.20 time: 0.157099 Aug 19 21:14:56.656223 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 368/668] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:14:56 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:14:57.446203 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-b3cf29e5-8513-4e12-b958-4119f933f372 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:57.446859 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-b3cf29e5-8513-4e12-b958-4119f933f372 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:57.453477 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3cf29e5-8513-4e12-b958-4119f933f372 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:57.454206 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3cf29e5-8513-4e12-b958-4119f933f372 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:57.454956 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3cf29e5-8513-4e12-b958-4119f933f372 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:57.455665 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3cf29e5-8513-4e12-b958-4119f933f372 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:57.456187 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3cf29e5-8513-4e12-b958-4119f933f372 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:57.456783 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3cf29e5-8513-4e12-b958-4119f933f372 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:57.599946 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b3cf29e5-8513-4e12-b958-4119f933f372 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:57.608442 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-b3cf29e5-8513-4e12-b958-4119f933f372 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f" status: 200 len: 1367 microversion: 2.1 time: 0.166516 Aug 19 21:14:57.608850 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 301/669] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:57 2022] GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:57.678674 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-13a3fbb4-d2ed-4ec5-9d01-3b6b40c17777 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:57.679598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-13a3fbb4-d2ed-4ec5-9d01-3b6b40c17777 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:57.686725 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-13a3fbb4-d2ed-4ec5-9d01-3b6b40c17777 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:57.687238 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-13a3fbb4-d2ed-4ec5-9d01-3b6b40c17777 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:57.687238 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-13a3fbb4-d2ed-4ec5-9d01-3b6b40c17777 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:57.688404 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-13a3fbb4-d2ed-4ec5-9d01-3b6b40c17777 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:57.688916 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-13a3fbb4-d2ed-4ec5-9d01-3b6b40c17777 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:57.689338 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-13a3fbb4-d2ed-4ec5-9d01-3b6b40c17777 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:57.837393 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-13a3fbb4-d2ed-4ec5-9d01-3b6b40c17777 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:57.845919 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-13a3fbb4-d2ed-4ec5-9d01-3b6b40c17777 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:57.847459 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-13a3fbb4-d2ed-4ec5-9d01-3b6b40c17777 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:57.848634 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-13a3fbb4-d2ed-4ec5-9d01-3b6b40c17777 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1722 microversion: 2.20 time: 0.173977 Aug 19 21:14:57.849190 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 369/670] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:14:57 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:14:58.628394 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-a1476668-5659-4afb-b778-36b2c796db4b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:58.628996 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-a1476668-5659-4afb-b778-36b2c796db4b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:58.636778 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a1476668-5659-4afb-b778-36b2c796db4b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:58.637270 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a1476668-5659-4afb-b778-36b2c796db4b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:58.637696 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a1476668-5659-4afb-b778-36b2c796db4b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:58.638412 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a1476668-5659-4afb-b778-36b2c796db4b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:58.638862 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a1476668-5659-4afb-b778-36b2c796db4b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:58.639274 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a1476668-5659-4afb-b778-36b2c796db4b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:58.873692 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-9a400fcf-7d68-432f-8b47-25b9895f926a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:14:58.874341 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-9a400fcf-7d68-432f-8b47-25b9895f926a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:14:58.881030 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9a400fcf-7d68-432f-8b47-25b9895f926a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:58.881530 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9a400fcf-7d68-432f-8b47-25b9895f926a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:58.882158 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9a400fcf-7d68-432f-8b47-25b9895f926a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:58.883217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9a400fcf-7d68-432f-8b47-25b9895f926a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:58.883670 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9a400fcf-7d68-432f-8b47-25b9895f926a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:58.884098 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9a400fcf-7d68-432f-8b47-25b9895f926a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:59.173793 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-a1476668-5659-4afb-b778-36b2c796db4b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:59.181884 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-a1476668-5659-4afb-b778-36b2c796db4b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f" status: 200 len: 1367 microversion: 2.1 time: 0.557155 Aug 19 21:14:59.182475 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 302/671] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:14:58 2022] GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f => generated 1367 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:14:59.228903 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-9a400fcf-7d68-432f-8b47-25b9895f926a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:59.237183 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-9a400fcf-7d68-432f-8b47-25b9895f926a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:59.238811 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-9a400fcf-7d68-432f-8b47-25b9895f926a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:14:59.240046 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-9a400fcf-7d68-432f-8b47-25b9895f926a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1722 microversion: 2.20 time: 0.370580 Aug 19 21:14:59.240689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 370/672] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:14:58 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1722 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:14:59.695784 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-70a500b0-0b80-4911-bd06-988ec1f3cdfa req-ae52e38e-81c9-4aef-ad1c-834d231142c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26867181-b826-417c-a967-774b70a8d82f", "name": "network-vif-plugged", "status": "completed", "tag": "59d9bc76-b59c-49ce-867d-9117c6cdb516"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:14:59.713271 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-70a500b0-0b80-4911-bd06-988ec1f3cdfa req-ae52e38e-81c9-4aef-ad1c-834d231142c8 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:59.714102 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-70a500b0-0b80-4911-bd06-988ec1f3cdfa req-ae52e38e-81c9-4aef-ad1c-834d231142c8 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:59.714740 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-70a500b0-0b80-4911-bd06-988ec1f3cdfa req-ae52e38e-81c9-4aef-ad1c-834d231142c8 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:59.726860 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-70a500b0-0b80-4911-bd06-988ec1f3cdfa req-ae52e38e-81c9-4aef-ad1c-834d231142c8 service nova] Creating event network-vif-plugged:59d9bc76-b59c-49ce-867d-9117c6cdb516 for instance 26867181-b826-417c-a967-774b70a8d82f on hv-cinder-85220 Aug 19 21:14:59.732617 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-70a500b0-0b80-4911-bd06-988ec1f3cdfa req-ae52e38e-81c9-4aef-ad1c-834d231142c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106963 Aug 19 21:14:59.733241 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 303/673] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:14:59.906137 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-e5716779-055a-4d2a-a9e7-03c51dc886ec req-ba49f3ee-0c1f-4cf8-a9b0-7c8769b6b86f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95c060a-e4cc-436c-a185-9345fd2c44f2", "name": "network-vif-deleted", "tag": "c65527c3-278b-404c-9369-abd76c37a0b5"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:14:59.921490 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-e5716779-055a-4d2a-a9e7-03c51dc886ec req-ba49f3ee-0c1f-4cf8-a9b0-7c8769b6b86f service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:14:59.922015 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-e5716779-055a-4d2a-a9e7-03c51dc886ec req-ba49f3ee-0c1f-4cf8-a9b0-7c8769b6b86f service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:14:59.922463 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-e5716779-055a-4d2a-a9e7-03c51dc886ec req-ba49f3ee-0c1f-4cf8-a9b0-7c8769b6b86f service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:14:59.950360 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-e5716779-055a-4d2a-a9e7-03c51dc886ec req-ba49f3ee-0c1f-4cf8-a9b0-7c8769b6b86f service nova] Creating event network-vif-deleted:c65527c3-278b-404c-9369-abd76c37a0b5 for instance f95c060a-e4cc-436c-a185-9345fd2c44f2 on hv-cinder-85220 Aug 19 21:14:59.955492 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-e5716779-055a-4d2a-a9e7-03c51dc886ec req-ba49f3ee-0c1f-4cf8-a9b0-7c8769b6b86f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054827 Aug 19 21:14:59.956754 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 371/674] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:15:00.203688 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-33dfc34f-044f-401c-bbce-7d35933ee792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:00.204276 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-33dfc34f-044f-401c-bbce-7d35933ee792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:00.211640 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-33dfc34f-044f-401c-bbce-7d35933ee792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:00.212129 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-33dfc34f-044f-401c-bbce-7d35933ee792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:00.212559 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-33dfc34f-044f-401c-bbce-7d35933ee792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:00.213257 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-33dfc34f-044f-401c-bbce-7d35933ee792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:00.213865 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-33dfc34f-044f-401c-bbce-7d35933ee792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:00.214289 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-33dfc34f-044f-401c-bbce-7d35933ee792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:00.271601 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-d9b799aa-7d37-4bab-b3f9-e78df1255a74 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:00.273592 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-d9b799aa-7d37-4bab-b3f9-e78df1255a74 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:00.283772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d9b799aa-7d37-4bab-b3f9-e78df1255a74 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:00.284470 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d9b799aa-7d37-4bab-b3f9-e78df1255a74 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:00.285018 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d9b799aa-7d37-4bab-b3f9-e78df1255a74 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:00.285949 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d9b799aa-7d37-4bab-b3f9-e78df1255a74 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:00.286529 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d9b799aa-7d37-4bab-b3f9-e78df1255a74 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:00.287207 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d9b799aa-7d37-4bab-b3f9-e78df1255a74 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:00.287918 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=2 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:00.305306 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:00.311184 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=6 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:00.328272 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d9b799aa-7d37-4bab-b3f9-e78df1255a74 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:00.328865 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d9b799aa-7d37-4bab-b3f9-e78df1255a74 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:00.329372 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d9b799aa-7d37-4bab-b3f9-e78df1255a74 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:00.329935 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.objects.instance [None req-d9b799aa-7d37-4bab-b3f9-e78df1255a74 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lazy-loading 'fault' on Instance uuid f95c060a-e4cc-436c-a185-9345fd2c44f2 {{(pid=120877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:15:00.370608 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-33dfc34f-044f-401c-bbce-7d35933ee792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:00.378963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-33dfc34f-044f-401c-bbce-7d35933ee792 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f" status: 200 len: 1367 microversion: 2.1 time: 0.179582 Aug 19 21:15:00.379704 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 304/675] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:00 2022] GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:00.388307 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-d9b799aa-7d37-4bab-b3f9-e78df1255a74 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:00.397095 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-d9b799aa-7d37-4bab-b3f9-e78df1255a74 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:00.399344 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-d9b799aa-7d37-4bab-b3f9-e78df1255a74 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:00.400551 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-d9b799aa-7d37-4bab-b3f9-e78df1255a74 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 200 len: 1371 microversion: 2.20 time: 0.137204 Aug 19 21:15:00.401113 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 372/676] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:15:00 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 1371 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:15:01.401242 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-24a01a0b-0d86-4fc6-926e-b90d02e4dafd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:01.401870 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-24a01a0b-0d86-4fc6-926e-b90d02e4dafd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:01.403815 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=6 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:01.409537 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-24a01a0b-0d86-4fc6-926e-b90d02e4dafd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:01.410046 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-24a01a0b-0d86-4fc6-926e-b90d02e4dafd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:01.410482 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-24a01a0b-0d86-4fc6-926e-b90d02e4dafd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:01.411169 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-24a01a0b-0d86-4fc6-926e-b90d02e4dafd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:01.411621 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-24a01a0b-0d86-4fc6-926e-b90d02e4dafd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:01.412040 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-24a01a0b-0d86-4fc6-926e-b90d02e4dafd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:01.423888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-b12e59c9-1fda-4e6c-9d98-41dd642c5b31 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:01.424495 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-b12e59c9-1fda-4e6c-9d98-41dd642c5b31 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:01.431320 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b12e59c9-1fda-4e6c-9d98-41dd642c5b31 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:01.431951 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b12e59c9-1fda-4e6c-9d98-41dd642c5b31 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:01.432254 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b12e59c9-1fda-4e6c-9d98-41dd642c5b31 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:01.432964 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b12e59c9-1fda-4e6c-9d98-41dd642c5b31 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:01.433473 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b12e59c9-1fda-4e6c-9d98-41dd642c5b31 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:01.433946 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b12e59c9-1fda-4e6c-9d98-41dd642c5b31 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:01.450226 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-b12e59c9-1fda-4e6c-9d98-41dd642c5b31 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] HTTP exception thrown: Instance f95c060a-e4cc-436c-a185-9345fd2c44f2 could not be found. Aug 19 21:15:01.452091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-b12e59c9-1fda-4e6c-9d98-41dd642c5b31 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Request method failure captured: Aug 19 21:15:01.452091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 HTTP/1.1 Aug 19 21:15:01.452091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:15:01.452091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:15:01.452091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:15:01.452091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:15:01.452091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:15:01.452091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:15:01.452091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:15:01.452091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:15:01.452091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__vX_fd2XAzIVTVnzwahI5JEgSTO_ZQCd4mbb9Zg6m9XGpBqSdAXjvcFQkgBdJEQdhdc6Wn3XvPJ8COqP3gjKFf71Zr5Og6s5GWeMOn8LQQxkZ3vnUdBeNkhAKKtxlTTURC1_e0Ov1ivpWx03EqtnxIl4yPHSmieIQAxbvrtqBluopM Aug 19 21:15:01.452091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:15:01.452091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:15:01.452091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:15:01.452091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:15:01.452091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Openstack-Nova-Api-Version: 2.20 Aug 19 21:15:01.452091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:15:01.452091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:15:01.452091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: a3902dce55324b7ab42df9de97bc11b4 Aug 19 21:15:01.452091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1474752608 Aug 19 21:15:01.452091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:15:01.452091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:15:01.454004 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a3902dce55324b7ab42df9de97bc11b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a3902dce55324b7ab42df9de97bc11b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a3902dce55324b7ab42df9de97bc11b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a3902dce55324b7ab42df9de97bc11b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:15:01.454004 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1474752608 Aug 19 21:15:01.454004 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: a3902dce55324b7ab42df9de97bc11b4 Aug 19 21:15:01.454004 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1474752608 Aug 19 21:15:01.454004 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-AttachVolumeShelveTestJSON-1474752608-project Aug 19 21:15:01.454004 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:15:01.454004 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:15:01.454004 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: 0809d96091c2476c83ec0c7c6c5a1509 Aug 19 21:15:01.454004 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1474752608-project Aug 19 21:15:01.454004 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: > Aug 19 21:15:01.454004 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Instance f95c060a-e4cc-436c-a185-9345fd2c44f2 could not be found. Aug 19 21:15:01.454004 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'id': 'f95c060a-e4cc-436c-a185-9345fd2c44f2'} Aug 19 21:15:01.454984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:15:01.454984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:15:01.454984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:15:01.454984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:15:01.454984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:15:01.454984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:15:01.454984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:15:01.454984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:15:01.454984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:15:01.454984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:15:01.454984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f95c060a-e4cc-436c-a185-9345fd2c44f2 could not be found. Aug 19 21:15:01.454984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:15:01.454984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:15:01.454984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:15:01.454984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:15:01.454984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:15:01.454984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:15:01.454984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:15:01.454984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:15:01.454984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:15:01.456400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:15:01.456400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:15:01.456400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:15:01.456400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:15:01.456400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:15:01.456400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:15:01.456400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:15:01.456400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f95c060a-e4cc-436c-a185-9345fd2c44f2 could not be found. Aug 19 21:15:01.456400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:15:01.456400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:15:01.456400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:15:01.456400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:15:01.456400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:15:01.456400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:15:01.456400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:15:01.456400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:15:01.456400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f95c060a-e4cc-436c-a185-9345fd2c44f2 could not be found. Aug 19 21:15:01.456400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:15:01.457891 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-b12e59c9-1fda-4e6c-9d98-41dd642c5b31 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Returning 404 to user: Instance f95c060a-e4cc-436c-a185-9345fd2c44f2 could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:15:01.457891 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-b12e59c9-1fda-4e6c-9d98-41dd642c5b31 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 404 len: 111 microversion: 2.20 time: 0.033928 Aug 19 21:15:01.457891 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 373/677] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:15:01 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 19 21:15:01.463567 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-80400dd1-168d-4ff2-b3f7-e8467171cf96 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '.version_select at 0x7f740bd7a8b0>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:01.484442 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-80400dd1-168d-4ff2-b3f7-e8467171cf96 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-999809797" status: 204 len: 0 microversion: 2.20 time: 0.025551 Aug 19 21:15:01.485233 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 374/678] 10.222.0.16 () {60 vars in 1259 bytes} [Fri Aug 19 21:15:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-999809797 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 19 21:15:01.607505 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-24a01a0b-0d86-4fc6-926e-b90d02e4dafd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:01.616005 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-24a01a0b-0d86-4fc6-926e-b90d02e4dafd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f" status: 200 len: 1367 microversion: 2.1 time: 0.219065 Aug 19 21:15:01.616596 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 305/679] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:01 2022] GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:02.189367 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3db45b30-1cda-40f7-aa6c-3533c45bfd92 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Action: 'create', calling method: .version_select at 0x7f740bc2c670>, body: {"keypair": {"name": "tempest-keypair-1213874356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGSsE+NtAAb4MivpuW3MSnqMirOniwUY5kM+C/kw5hlz9ssnfUwXdVbtbhh/ZHjPoGs3ToKe3Hcr4e9/zE4GbkMZc0bsbIBWMLbTL4D/uBUAEWHvGDL2kArzrrCxKU8qQ=="}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:15:02.205548 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-3db45b30-1cda-40f7-aa6c-3533c45bfd92 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Getting quotas for project a3902dce55324b7ab42df9de97bc11b4. Resources: {'key_pairs'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:15:02.210790 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-3db45b30-1cda-40f7-aa6c-3533c45bfd92 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Getting quotas for user 0809d96091c2476c83ec0c7c6c5a1509 and project a3902dce55324b7ab42df9de97bc11b4. Resources: {'key_pairs'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:15:02.233030 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-3db45b30-1cda-40f7-aa6c-3533c45bfd92 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047647 Aug 19 21:15:02.233612 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 375/680] 10.222.0.16 () {62 vars in 1200 bytes} [Fri Aug 19 21:15:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 19 21:15:02.637957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-baf07f8a-59b6-4e20-94b0-e9370d40f44a tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:02.638584 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-baf07f8a-59b6-4e20-94b0-e9370d40f44a tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:02.645194 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-baf07f8a-59b6-4e20-94b0-e9370d40f44a tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:02.645678 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-baf07f8a-59b6-4e20-94b0-e9370d40f44a tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:02.646260 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-baf07f8a-59b6-4e20-94b0-e9370d40f44a tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:02.646977 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-baf07f8a-59b6-4e20-94b0-e9370d40f44a tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:02.647987 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-baf07f8a-59b6-4e20-94b0-e9370d40f44a tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:02.648622 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-baf07f8a-59b6-4e20-94b0-e9370d40f44a tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:02.878222 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-baf07f8a-59b6-4e20-94b0-e9370d40f44a tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:02.886360 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-baf07f8a-59b6-4e20-94b0-e9370d40f44a tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f" status: 200 len: 1557 microversion: 2.1 time: 0.252914 Aug 19 21:15:02.887221 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 306/681] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:02 2022] GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f => generated 1557 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:02.907955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-36aadca7-8430-4393-9293-d98df7959418 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:02.908527 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-36aadca7-8430-4393-9293-d98df7959418 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:02.916346 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-36aadca7-8430-4393-9293-d98df7959418 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:02.916908 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-36aadca7-8430-4393-9293-d98df7959418 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:02.917533 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-36aadca7-8430-4393-9293-d98df7959418 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:02.918408 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-36aadca7-8430-4393-9293-d98df7959418 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:02.919004 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-36aadca7-8430-4393-9293-d98df7959418 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:02.919462 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-36aadca7-8430-4393-9293-d98df7959418 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:03.048970 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-36aadca7-8430-4393-9293-d98df7959418 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.144727 Aug 19 21:15:03.049899 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 376/682] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Aug 19 21:15:02 2022] GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:15:03.752619 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-ef2f24ad-19fd-44f0-a160-19f382518cc2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-993648074", "imageRef": "d1f034cf-f103-477b-bbb5-3298c678db05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2dcec4c-6e1c-499b-93c8-b09724f309db"}], "security_groups": [{"name": "tempest-securitygroup--991224153"}], "key_name": "tempest-keypair-1213874356", "user_data": "}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:15:03.909626 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.network.neutron [None req-ef2f24ad-19fd-44f0-a160-19f382518cc2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] validate_networks() for [('a2dcec4c-6e1c-499b-93c8-b09724f309db', None, None, None, None, None)] {{(pid=120876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 21:15:04.467337 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-4ed8824f-94ce-41e5-9fcc-28225b26fa1f req-6cdf9e6f-5703-4a8e-a30e-0466ce813f38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26867181-b826-417c-a967-774b70a8d82f", "tag": "59d9bc76-b59c-49ce-867d-9117c6cdb516"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:15:04.479307 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-ef2f24ad-19fd-44f0-a160-19f382518cc2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Flavor limits 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 21:15:04.479736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-ef2f24ad-19fd-44f0-a160-19f382518cc2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Image limits 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 21:15:04.480205 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-ef2f24ad-19fd-44f0-a160-19f382518cc2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Flavor pref 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 21:15:04.480613 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-ef2f24ad-19fd-44f0-a160-19f382518cc2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Image pref 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 21:15:04.481374 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-ef2f24ad-19fd-44f0-a160-19f382518cc2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 21:15:04.485900 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-4ed8824f-94ce-41e5-9fcc-28225b26fa1f req-6cdf9e6f-5703-4a8e-a30e-0466ce813f38 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:04.486788 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-4ed8824f-94ce-41e5-9fcc-28225b26fa1f req-6cdf9e6f-5703-4a8e-a30e-0466ce813f38 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:04.487622 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-4ed8824f-94ce-41e5-9fcc-28225b26fa1f req-6cdf9e6f-5703-4a8e-a30e-0466ce813f38 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:04.490726 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ef2f24ad-19fd-44f0-a160-19f382518cc2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:04.491912 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ef2f24ad-19fd-44f0-a160-19f382518cc2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:04.492549 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ef2f24ad-19fd-44f0-a160-19f382518cc2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:04.493309 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ef2f24ad-19fd-44f0-a160-19f382518cc2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:04.493818 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ef2f24ad-19fd-44f0-a160-19f382518cc2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:04.494231 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ef2f24ad-19fd-44f0-a160-19f382518cc2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:04.506602 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-4ed8824f-94ce-41e5-9fcc-28225b26fa1f req-6cdf9e6f-5703-4a8e-a30e-0466ce813f38 service nova] Creating event network-changed:59d9bc76-b59c-49ce-867d-9117c6cdb516 for instance 26867181-b826-417c-a967-774b70a8d82f on hv-cinder-85220 Aug 19 21:15:04.512990 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-4ed8824f-94ce-41e5-9fcc-28225b26fa1f req-6cdf9e6f-5703-4a8e-a30e-0466ce813f38 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053820 Aug 19 21:15:04.513604 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 377/683] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:15:04.515363 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-ef2f24ad-19fd-44f0-a160-19f382518cc2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Getting quotas for project a3902dce55324b7ab42df9de97bc11b4. Resources: {'cores', 'ram', 'instances'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:15:04.521853 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-ef2f24ad-19fd-44f0-a160-19f382518cc2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Getting quotas for user 0809d96091c2476c83ec0c7c6c5a1509 and project a3902dce55324b7ab42df9de97bc11b4. Resources: {'cores', 'ram', 'instances'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:15:04.540802 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-ef2f24ad-19fd-44f0-a160-19f382518cc2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Going to run 1 instances... {{(pid=120876) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 21:15:04.546988 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-ef2f24ad-19fd-44f0-a160-19f382518cc2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f034cf-f103-477b-bbb5-3298c678db05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 21:15:04.599729 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-ef2f24ad-19fd-44f0-a160-19f382518cc2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.854571 Aug 19 21:15:04.607427 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 307/684] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Aug 19 21:15:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 19 21:15:04.615551 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ecd07600-a63d-4514-af76-4507f4811109 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:04.616449 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ecd07600-a63d-4514-af76-4507f4811109 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:04.704985 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ecd07600-a63d-4514-af76-4507f4811109 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:04.715906 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ecd07600-a63d-4514-af76-4507f4811109 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:04.719470 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ecd07600-a63d-4514-af76-4507f4811109 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:04.721797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ecd07600-a63d-4514-af76-4507f4811109 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1281 microversion: 2.20 time: 0.111725 Aug 19 21:15:04.732628 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 378/685] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:15:04 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1281 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:15:05.750781 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-f98c09c1-4b9c-42fe-b12c-ac77771cfb49 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:05.752830 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-f98c09c1-4b9c-42fe-b12c-ac77771cfb49 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:05.763620 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f98c09c1-4b9c-42fe-b12c-ac77771cfb49 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:05.764279 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f98c09c1-4b9c-42fe-b12c-ac77771cfb49 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:05.764922 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f98c09c1-4b9c-42fe-b12c-ac77771cfb49 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:05.766041 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f98c09c1-4b9c-42fe-b12c-ac77771cfb49 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:05.766751 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f98c09c1-4b9c-42fe-b12c-ac77771cfb49 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:05.767340 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f98c09c1-4b9c-42fe-b12c-ac77771cfb49 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:05.845026 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-f98c09c1-4b9c-42fe-b12c-ac77771cfb49 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:05.861592 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-f98c09c1-4b9c-42fe-b12c-ac77771cfb49 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:05.863916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-f98c09c1-4b9c-42fe-b12c-ac77771cfb49 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:05.865293 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-f98c09c1-4b9c-42fe-b12c-ac77771cfb49 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1341 microversion: 2.20 time: 0.124056 Aug 19 21:15:05.877877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 308/686] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:15:05 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1341 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:15:06.894887 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-fbb6c87f-4aae-4cf8-9ede-55bda04e224c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:06.896013 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-fbb6c87f-4aae-4cf8-9ede-55bda04e224c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:06.905895 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fbb6c87f-4aae-4cf8-9ede-55bda04e224c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:06.906416 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fbb6c87f-4aae-4cf8-9ede-55bda04e224c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:06.906843 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fbb6c87f-4aae-4cf8-9ede-55bda04e224c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:06.907567 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fbb6c87f-4aae-4cf8-9ede-55bda04e224c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:06.908058 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fbb6c87f-4aae-4cf8-9ede-55bda04e224c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:06.908488 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fbb6c87f-4aae-4cf8-9ede-55bda04e224c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:07.111836 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-fbb6c87f-4aae-4cf8-9ede-55bda04e224c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:07.122258 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-fbb6c87f-4aae-4cf8-9ede-55bda04e224c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:07.123965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-fbb6c87f-4aae-4cf8-9ede-55bda04e224c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:07.125185 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-fbb6c87f-4aae-4cf8-9ede-55bda04e224c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1406 microversion: 2.20 time: 0.237535 Aug 19 21:15:07.126737 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 379/687] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:15:06 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:15:07.610783 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-3dc4e8f7-1fbb-4c09-9c8e-a857815a7140 req-2779cbb2-717d-4904-bf8f-76080e445396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5be0a3d-0419-4d69-83b2-22939e9c9bce", "tag": "eb7288c4-808b-4ef2-91d6-8f6c15db4227"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:15:07.633461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-3dc4e8f7-1fbb-4c09-9c8e-a857815a7140 req-2779cbb2-717d-4904-bf8f-76080e445396 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:07.634389 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-3dc4e8f7-1fbb-4c09-9c8e-a857815a7140 req-2779cbb2-717d-4904-bf8f-76080e445396 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:07.635185 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-3dc4e8f7-1fbb-4c09-9c8e-a857815a7140 req-2779cbb2-717d-4904-bf8f-76080e445396 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:07.650833 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-3dc4e8f7-1fbb-4c09-9c8e-a857815a7140 req-2779cbb2-717d-4904-bf8f-76080e445396 service nova] Creating event network-changed:eb7288c4-808b-4ef2-91d6-8f6c15db4227 for instance e5be0a3d-0419-4d69-83b2-22939e9c9bce on hv-cinder-85220 Aug 19 21:15:07.656196 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-3dc4e8f7-1fbb-4c09-9c8e-a857815a7140 req-2779cbb2-717d-4904-bf8f-76080e445396 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052855 Aug 19 21:15:07.657385 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 309/688] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:15:08.151201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-dced50f9-e5bb-47d3-9e9f-9924c6092822 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:08.151967 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-dced50f9-e5bb-47d3-9e9f-9924c6092822 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:08.163006 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dced50f9-e5bb-47d3-9e9f-9924c6092822 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:08.163922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dced50f9-e5bb-47d3-9e9f-9924c6092822 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:08.164705 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dced50f9-e5bb-47d3-9e9f-9924c6092822 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:08.166000 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dced50f9-e5bb-47d3-9e9f-9924c6092822 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:08.166728 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dced50f9-e5bb-47d3-9e9f-9924c6092822 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:08.167172 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dced50f9-e5bb-47d3-9e9f-9924c6092822 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:08.309274 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-dced50f9-e5bb-47d3-9e9f-9924c6092822 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:08.319878 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-dced50f9-e5bb-47d3-9e9f-9924c6092822 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:08.322065 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-dced50f9-e5bb-47d3-9e9f-9924c6092822 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:08.323185 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-dced50f9-e5bb-47d3-9e9f-9924c6092822 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1406 microversion: 2.20 time: 0.177051 Aug 19 21:15:08.323746 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 380/689] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:15:08 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:15:09.347469 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-71f55854-cfba-43a8-b36b-7ef10f404b4d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:09.348073 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-71f55854-cfba-43a8-b36b-7ef10f404b4d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:09.355914 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71f55854-cfba-43a8-b36b-7ef10f404b4d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:09.356398 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71f55854-cfba-43a8-b36b-7ef10f404b4d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:09.356834 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71f55854-cfba-43a8-b36b-7ef10f404b4d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:09.357522 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71f55854-cfba-43a8-b36b-7ef10f404b4d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:09.358130 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71f55854-cfba-43a8-b36b-7ef10f404b4d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:09.358698 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71f55854-cfba-43a8-b36b-7ef10f404b4d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:09.506011 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-71f55854-cfba-43a8-b36b-7ef10f404b4d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:09.516791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-71f55854-cfba-43a8-b36b-7ef10f404b4d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:09.518617 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-71f55854-cfba-43a8-b36b-7ef10f404b4d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:09.519848 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-71f55854-cfba-43a8-b36b-7ef10f404b4d tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1406 microversion: 2.20 time: 0.177103 Aug 19 21:15:09.520672 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 310/690] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:15:09 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:15:10.544345 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-48fc6b6f-def9-4a04-966c-9f3b29e78403 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:10.545499 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-48fc6b6f-def9-4a04-966c-9f3b29e78403 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:10.554942 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-48fc6b6f-def9-4a04-966c-9f3b29e78403 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:10.555183 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-48fc6b6f-def9-4a04-966c-9f3b29e78403 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:10.555585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-48fc6b6f-def9-4a04-966c-9f3b29e78403 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:10.556296 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-48fc6b6f-def9-4a04-966c-9f3b29e78403 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:10.556749 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-48fc6b6f-def9-4a04-966c-9f3b29e78403 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:10.557169 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-48fc6b6f-def9-4a04-966c-9f3b29e78403 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:10.744231 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-48fc6b6f-def9-4a04-966c-9f3b29e78403 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:10.753100 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-48fc6b6f-def9-4a04-966c-9f3b29e78403 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:10.754641 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-48fc6b6f-def9-4a04-966c-9f3b29e78403 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:10.755781 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-48fc6b6f-def9-4a04-966c-9f3b29e78403 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1406 microversion: 2.20 time: 0.215646 Aug 19 21:15:10.756350 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 381/691] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:15:10 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:15:11.785733 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-9de52893-73a6-49b7-9cec-671e74cb8160 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:11.799138 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-9de52893-73a6-49b7-9cec-671e74cb8160 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:11.816591 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9de52893-73a6-49b7-9cec-671e74cb8160 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:11.817135 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9de52893-73a6-49b7-9cec-671e74cb8160 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:11.817845 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9de52893-73a6-49b7-9cec-671e74cb8160 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:11.818811 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9de52893-73a6-49b7-9cec-671e74cb8160 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:11.819619 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9de52893-73a6-49b7-9cec-671e74cb8160 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:11.820142 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9de52893-73a6-49b7-9cec-671e74cb8160 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:11.992963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9de52893-73a6-49b7-9cec-671e74cb8160 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:12.004941 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9de52893-73a6-49b7-9cec-671e74cb8160 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:12.007329 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9de52893-73a6-49b7-9cec-671e74cb8160 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:12.008916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-9de52893-73a6-49b7-9cec-671e74cb8160 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1406 microversion: 2.20 time: 0.231989 Aug 19 21:15:12.009514 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 311/692] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:15:11 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:15:13.036592 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0e1b3535-46d7-4bb2-80b0-39ae0da4bbb4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:13.039457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0e1b3535-46d7-4bb2-80b0-39ae0da4bbb4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:13.041491 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:13.047510 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0e1b3535-46d7-4bb2-80b0-39ae0da4bbb4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:13.047998 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0e1b3535-46d7-4bb2-80b0-39ae0da4bbb4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:13.048440 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0e1b3535-46d7-4bb2-80b0-39ae0da4bbb4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:13.049142 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0e1b3535-46d7-4bb2-80b0-39ae0da4bbb4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:13.049590 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0e1b3535-46d7-4bb2-80b0-39ae0da4bbb4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:13.050038 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0e1b3535-46d7-4bb2-80b0-39ae0da4bbb4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:13.220304 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0e1b3535-46d7-4bb2-80b0-39ae0da4bbb4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:13.229876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0e1b3535-46d7-4bb2-80b0-39ae0da4bbb4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:13.231443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0e1b3535-46d7-4bb2-80b0-39ae0da4bbb4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:13.232615 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0e1b3535-46d7-4bb2-80b0-39ae0da4bbb4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1406 microversion: 2.20 time: 0.200319 Aug 19 21:15:13.233201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 382/693] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:15:13 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:15:13.754485 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-cb3b2056-6e7f-418a-a14a-bf15f5c1794c req-81ca6abc-8c3d-438e-8872-0b0311b8a2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5be0a3d-0419-4d69-83b2-22939e9c9bce", "name": "network-vif-plugged", "status": "completed", "tag": "eb7288c4-808b-4ef2-91d6-8f6c15db4227"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:15:13.784507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-cb3b2056-6e7f-418a-a14a-bf15f5c1794c req-81ca6abc-8c3d-438e-8872-0b0311b8a2b8 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:13.785287 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-cb3b2056-6e7f-418a-a14a-bf15f5c1794c req-81ca6abc-8c3d-438e-8872-0b0311b8a2b8 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:13.786035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-cb3b2056-6e7f-418a-a14a-bf15f5c1794c req-81ca6abc-8c3d-438e-8872-0b0311b8a2b8 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:13.809052 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-cb3b2056-6e7f-418a-a14a-bf15f5c1794c req-81ca6abc-8c3d-438e-8872-0b0311b8a2b8 service nova] Creating event network-vif-plugged:eb7288c4-808b-4ef2-91d6-8f6c15db4227 for instance e5be0a3d-0419-4d69-83b2-22939e9c9bce on hv-cinder-85220 Aug 19 21:15:13.818109 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-cb3b2056-6e7f-418a-a14a-bf15f5c1794c req-81ca6abc-8c3d-438e-8872-0b0311b8a2b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075388 Aug 19 21:15:13.820136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 312/694] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:15:14.255338 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-b423684d-eb97-4b63-a3d7-180080e6b259 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:14.255921 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-b423684d-eb97-4b63-a3d7-180080e6b259 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:14.263989 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b423684d-eb97-4b63-a3d7-180080e6b259 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:14.264468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b423684d-eb97-4b63-a3d7-180080e6b259 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:14.264899 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b423684d-eb97-4b63-a3d7-180080e6b259 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:14.265591 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b423684d-eb97-4b63-a3d7-180080e6b259 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:14.266069 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b423684d-eb97-4b63-a3d7-180080e6b259 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:14.266488 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b423684d-eb97-4b63-a3d7-180080e6b259 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:14.403309 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-b423684d-eb97-4b63-a3d7-180080e6b259 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:14.411432 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-b423684d-eb97-4b63-a3d7-180080e6b259 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:14.414020 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-b423684d-eb97-4b63-a3d7-180080e6b259 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:14.415121 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-b423684d-eb97-4b63-a3d7-180080e6b259 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1406 microversion: 2.20 time: 0.163702 Aug 19 21:15:14.415679 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 383/695] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:15:14 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:15:14.534470 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-a1746744-a27e-4d08-90a8-8c11ae24f633 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1911929329"}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:15:14.535084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-a1746744-a27e-4d08-90a8-8c11ae24f633 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:14.537010 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=2 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:14.538207 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=6 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:14.545191 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a1746744-a27e-4d08-90a8-8c11ae24f633 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:14.545675 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a1746744-a27e-4d08-90a8-8c11ae24f633 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:14.546289 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a1746744-a27e-4d08-90a8-8c11ae24f633 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:14.546978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a1746744-a27e-4d08-90a8-8c11ae24f633 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:14.547425 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a1746744-a27e-4d08-90a8-8c11ae24f633 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:14.547845 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a1746744-a27e-4d08-90a8-8c11ae24f633 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:14.690924 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.network.security_group_api [None req-a1746744-a27e-4d08-90a8-8c11ae24f633 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Removing security group 15909ec0-52a2-48d5-a5bb-eebec0ea9005 from port dc06a7d7-d9fe-4dd6-8dab-d1c3f12f11f3 Aug 19 21:15:15.017011 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-a1746744-a27e-4d08-90a8-8c11ae24f633 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "POST /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c/action" status: 202 len: 0 microversion: 2.1 time: 0.486663 Aug 19 21:15:15.018031 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 313/696] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Aug 19 21:15:14 2022] POST /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:15:15.054231 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-137aefcc-1111-447d-9d4c-cbb7c1b3c16f req-43ae8b0e-888e-4e41-b512-624b8caaba60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea09e576-f3ee-4b10-813f-23574635c10c", "tag": "dc06a7d7-d9fe-4dd6-8dab-d1c3f12f11f3"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:15:15.063370 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=6 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:15.065600 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-137aefcc-1111-447d-9d4c-cbb7c1b3c16f req-43ae8b0e-888e-4e41-b512-624b8caaba60 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:15.066321 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-137aefcc-1111-447d-9d4c-cbb7c1b3c16f req-43ae8b0e-888e-4e41-b512-624b8caaba60 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:15.066955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-137aefcc-1111-447d-9d4c-cbb7c1b3c16f req-43ae8b0e-888e-4e41-b512-624b8caaba60 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:15.083051 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-137aefcc-1111-447d-9d4c-cbb7c1b3c16f req-43ae8b0e-888e-4e41-b512-624b8caaba60 service nova] Creating event network-changed:dc06a7d7-d9fe-4dd6-8dab-d1c3f12f11f3 for instance ea09e576-f3ee-4b10-813f-23574635c10c on hv-cinder-85220 Aug 19 21:15:15.092592 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-137aefcc-1111-447d-9d4c-cbb7c1b3c16f req-43ae8b0e-888e-4e41-b512-624b8caaba60 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040737 Aug 19 21:15:15.093928 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 384/697] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:15:15.440353 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-dade96da-20c4-468f-b8aa-22523548e963 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:15.440977 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-dade96da-20c4-468f-b8aa-22523548e963 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:15.448173 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dade96da-20c4-468f-b8aa-22523548e963 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:15.448583 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dade96da-20c4-468f-b8aa-22523548e963 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:15.450501 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dade96da-20c4-468f-b8aa-22523548e963 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:15.451295 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dade96da-20c4-468f-b8aa-22523548e963 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:15.451768 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dade96da-20c4-468f-b8aa-22523548e963 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:15.452214 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dade96da-20c4-468f-b8aa-22523548e963 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:15.681866 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-dade96da-20c4-468f-b8aa-22523548e963 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:15.691187 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-dade96da-20c4-468f-b8aa-22523548e963 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:15.693135 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-dade96da-20c4-468f-b8aa-22523548e963 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:15.695098 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-dade96da-20c4-468f-b8aa-22523548e963 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1406 microversion: 2.20 time: 0.258811 Aug 19 21:15:15.710574 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 314/698] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:15:15 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1406 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:15:16.238935 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-f0079a0e-e0f7-4c6b-8770-510d8cb596cc tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:16.239793 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-f0079a0e-e0f7-4c6b-8770-510d8cb596cc tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:16.247594 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f0079a0e-e0f7-4c6b-8770-510d8cb596cc tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:16.248237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f0079a0e-e0f7-4c6b-8770-510d8cb596cc tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:16.248921 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f0079a0e-e0f7-4c6b-8770-510d8cb596cc tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:16.249744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f0079a0e-e0f7-4c6b-8770-510d8cb596cc tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:16.250472 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f0079a0e-e0f7-4c6b-8770-510d8cb596cc tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:16.251000 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f0079a0e-e0f7-4c6b-8770-510d8cb596cc tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:16.364318 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.objects.instance [None req-f0079a0e-e0f7-4c6b-8770-510d8cb596cc tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lazy-loading 'services' on Instance uuid ea09e576-f3ee-4b10-813f-23574635c10c {{(pid=120877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:15:16.464813 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-f0079a0e-e0f7-4c6b-8770-510d8cb596cc tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c/os-volume_attachments/ff854d78-15a0-44a4-a01f-3568c8d7f76f" status: 202 len: 0 microversion: 2.1 time: 0.230767 Aug 19 21:15:16.465874 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 385/699] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Aug 19 21:15:16 2022] DELETE /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c/os-volume_attachments/ff854d78-15a0-44a4-a01f-3568c8d7f76f => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:15:16.478808 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-8ff135c5-4d3b-41d5-90b4-fab7d07b8778 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:16.483547 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-8ff135c5-4d3b-41d5-90b4-fab7d07b8778 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:16.495296 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8ff135c5-4d3b-41d5-90b4-fab7d07b8778 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:16.496148 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8ff135c5-4d3b-41d5-90b4-fab7d07b8778 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:16.496907 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8ff135c5-4d3b-41d5-90b4-fab7d07b8778 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:16.498123 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8ff135c5-4d3b-41d5-90b4-fab7d07b8778 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:16.498923 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8ff135c5-4d3b-41d5-90b4-fab7d07b8778 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:16.499671 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8ff135c5-4d3b-41d5-90b4-fab7d07b8778 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:16.548567 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-8ff135c5-4d3b-41d5-90b4-fab7d07b8778 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077423 Aug 19 21:15:16.549417 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 315/700] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Aug 19 21:15:16 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:15:16.718697 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-345f6870-6148-4d16-8934-0becbd9fd780 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:16.719417 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-345f6870-6148-4d16-8934-0becbd9fd780 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:16.726231 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-345f6870-6148-4d16-8934-0becbd9fd780 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:16.726759 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-345f6870-6148-4d16-8934-0becbd9fd780 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:16.727202 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-345f6870-6148-4d16-8934-0becbd9fd780 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:16.727917 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-345f6870-6148-4d16-8934-0becbd9fd780 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:16.728358 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-345f6870-6148-4d16-8934-0becbd9fd780 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:16.728783 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-345f6870-6148-4d16-8934-0becbd9fd780 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:16.880346 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-345f6870-6148-4d16-8934-0becbd9fd780 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:16.890662 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-345f6870-6148-4d16-8934-0becbd9fd780 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:16.892215 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-345f6870-6148-4d16-8934-0becbd9fd780 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:16.893424 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-345f6870-6148-4d16-8934-0becbd9fd780 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1597 microversion: 2.20 time: 0.179058 Aug 19 21:15:16.894004 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 386/701] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:15:16 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1597 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:15:16.918811 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-64311cb5-cf0e-4695-937e-f96751466b0a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:16.919406 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-64311cb5-cf0e-4695-937e-f96751466b0a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:16.925628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-64311cb5-cf0e-4695-937e-f96751466b0a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:16.926299 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-64311cb5-cf0e-4695-937e-f96751466b0a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:16.926737 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-64311cb5-cf0e-4695-937e-f96751466b0a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:16.927442 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-64311cb5-cf0e-4695-937e-f96751466b0a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:16.927899 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-64311cb5-cf0e-4695-937e-f96751466b0a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:16.929605 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-64311cb5-cf0e-4695-937e-f96751466b0a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:17.014403 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-64311cb5-cf0e-4695-937e-f96751466b0a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.100630 Aug 19 21:15:17.015206 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 316/702] 10.222.0.16 () {60 vars in 1316 bytes} [Fri Aug 19 21:15:16 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 21:15:17.110506 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-7584b78f-900c-431d-a306-f0e240a2903a req-bfa00aff-2465-414d-9901-dae0e4fef9db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea09e576-f3ee-4b10-813f-23574635c10c", "tag": "dc06a7d7-d9fe-4dd6-8dab-d1c3f12f11f3"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:15:17.120172 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-7584b78f-900c-431d-a306-f0e240a2903a req-bfa00aff-2465-414d-9901-dae0e4fef9db service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:17.120651 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-7584b78f-900c-431d-a306-f0e240a2903a req-bfa00aff-2465-414d-9901-dae0e4fef9db service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:17.121701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-7584b78f-900c-431d-a306-f0e240a2903a req-bfa00aff-2465-414d-9901-dae0e4fef9db service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:17.135012 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-7584b78f-900c-431d-a306-f0e240a2903a req-bfa00aff-2465-414d-9901-dae0e4fef9db service nova] Creating event network-changed:dc06a7d7-d9fe-4dd6-8dab-d1c3f12f11f3 for instance ea09e576-f3ee-4b10-813f-23574635c10c on hv-cinder-85220 Aug 19 21:15:17.140925 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-7584b78f-900c-431d-a306-f0e240a2903a req-bfa00aff-2465-414d-9901-dae0e4fef9db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033972 Aug 19 21:15:17.141536 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 387/703] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:15:17.561472 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-cb597716-8696-48c9-b9c8-8945434f5606 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:17.563659 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-cb597716-8696-48c9-b9c8-8945434f5606 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:17.570178 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cb597716-8696-48c9-b9c8-8945434f5606 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:17.570670 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cb597716-8696-48c9-b9c8-8945434f5606 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:17.571102 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cb597716-8696-48c9-b9c8-8945434f5606 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:17.571812 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cb597716-8696-48c9-b9c8-8945434f5606 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:17.572264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cb597716-8696-48c9-b9c8-8945434f5606 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:17.572682 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cb597716-8696-48c9-b9c8-8945434f5606 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:17.611075 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-cb597716-8696-48c9-b9c8-8945434f5606 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054162 Aug 19 21:15:17.612323 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 317/704] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Aug 19 21:15:17 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:15:18.371381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-51f54e70-f16d-4491-aec9-30659860d8fb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:18.372006 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-51f54e70-f16d-4491-aec9-30659860d8fb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:18.379135 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-51f54e70-f16d-4491-aec9-30659860d8fb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:18.379625 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-51f54e70-f16d-4491-aec9-30659860d8fb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:18.380064 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-51f54e70-f16d-4491-aec9-30659860d8fb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:18.380812 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-51f54e70-f16d-4491-aec9-30659860d8fb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:18.381816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-51f54e70-f16d-4491-aec9-30659860d8fb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:18.382259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-51f54e70-f16d-4491-aec9-30659860d8fb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:18.476739 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.objects.instance [None req-51f54e70-f16d-4491-aec9-30659860d8fb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lazy-loading 'services' on Instance uuid 7df3ead0-b255-4b0c-8fa7-f9ae80138539 {{(pid=120877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:15:18.554641 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-51f54e70-f16d-4491-aec9-30659860d8fb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539/os-volume_attachments/c7eb9ec7-6490-41fc-959e-4c2f4cec33b1" status: 202 len: 0 microversion: 2.1 time: 0.188339 Aug 19 21:15:18.555458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 388/705] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Aug 19 21:15:18 2022] DELETE /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539/os-volume_attachments/c7eb9ec7-6490-41fc-959e-4c2f4cec33b1 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:15:18.564070 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-fb592f7b-5dce-4fe3-a674-b127cd2ecbbe tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:18.566292 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-fb592f7b-5dce-4fe3-a674-b127cd2ecbbe tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:18.574451 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fb592f7b-5dce-4fe3-a674-b127cd2ecbbe tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:18.575001 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fb592f7b-5dce-4fe3-a674-b127cd2ecbbe tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:18.575433 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fb592f7b-5dce-4fe3-a674-b127cd2ecbbe tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:18.576251 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fb592f7b-5dce-4fe3-a674-b127cd2ecbbe tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:18.576699 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fb592f7b-5dce-4fe3-a674-b127cd2ecbbe tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:18.577306 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fb592f7b-5dce-4fe3-a674-b127cd2ecbbe tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:18.604905 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:18.611670 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-fb592f7b-5dce-4fe3-a674-b127cd2ecbbe tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051589 Aug 19 21:15:18.612287 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 318/706] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Aug 19 21:15:18 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:15:18.624051 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ba34bd25-cc8c-4873-9184-61e7472e476a tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:18.626512 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ba34bd25-cc8c-4873-9184-61e7472e476a tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:18.633680 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ba34bd25-cc8c-4873-9184-61e7472e476a tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:18.634230 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ba34bd25-cc8c-4873-9184-61e7472e476a tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:18.634667 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ba34bd25-cc8c-4873-9184-61e7472e476a tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:18.635366 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ba34bd25-cc8c-4873-9184-61e7472e476a tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:18.635825 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ba34bd25-cc8c-4873-9184-61e7472e476a tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:18.636293 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ba34bd25-cc8c-4873-9184-61e7472e476a tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:18.669747 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ba34bd25-cc8c-4873-9184-61e7472e476a tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049928 Aug 19 21:15:18.670912 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 389/707] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Aug 19 21:15:18 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 21:15:18.682685 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-0ba041f3-9ed1-4015-bf65-aa3709990c5d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:18.683185 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-0ba041f3-9ed1-4015-bf65-aa3709990c5d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:18.689963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0ba041f3-9ed1-4015-bf65-aa3709990c5d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:18.690458 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0ba041f3-9ed1-4015-bf65-aa3709990c5d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:18.690913 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0ba041f3-9ed1-4015-bf65-aa3709990c5d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:18.691833 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0ba041f3-9ed1-4015-bf65-aa3709990c5d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:18.692292 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0ba041f3-9ed1-4015-bf65-aa3709990c5d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:18.692849 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0ba041f3-9ed1-4015-bf65-aa3709990c5d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:18.795860 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-0ba041f3-9ed1-4015-bf65-aa3709990c5d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] HTTP exception thrown: Instance ea09e576-f3ee-4b10-813f-23574635c10c is not attached to volume ff854d78-15a0-44a4-a01f-3568c8d7f76f Aug 19 21:15:18.805628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-0ba041f3-9ed1-4015-bf65-aa3709990c5d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Request method failure captured: Aug 19 21:15:18.805628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: DELETE /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c/os-volume_attachments/ff854d78-15a0-44a4-a01f-3568c8d7f76f HTTP/1.1 Aug 19 21:15:18.805628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:15:18.805628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:15:18.805628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:15:18.805628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:15:18.805628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:15:18.805628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:15:18.805628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:15:18.805628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:15:18.805628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__xoTzI0YJ7DxoEXvWeaRwS9XcShMbVMfNVExPjcjrAAW1B5G0QA6E0UsAmeEtv09IqHk5kVvdPB64FYTnqMqGMfJ1wOLFi62i-APWPluUnnQfFGzJfiQ5BzSOTjCApYODDDUTG4A6r-sZdVcVwUduns-ixw3HREMaT9gkT5BydPxpk Aug 19 21:15:18.805628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:15:18.805628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:15:18.805628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:15:18.805628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:15:18.805628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:15:18.805628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:15:18.805628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: cf734543b7e0426d93654f18f0d98e4a Aug 19 21:15:18.805628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-TestMinimumBasicScenario-1421082107 Aug 19 21:15:18.805628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:15:18.805628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:15:18.807939 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf734543b7e0426d93654f18f0d98e4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf734543b7e0426d93654f18f0d98e4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf734543b7e0426d93654f18f0d98e4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf734543b7e0426d93654f18f0d98e4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:15:18.807939 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-TestMinimumBasicScenario-1421082107 Aug 19 21:15:18.807939 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: cf734543b7e0426d93654f18f0d98e4a Aug 19 21:15:18.807939 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1421082107 Aug 19 21:15:18.807939 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-TestMinimumBasicScenario-1421082107-project Aug 19 21:15:18.807939 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:15:18.807939 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:15:18.807939 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: 90472736cbcf497c89f0ae1582bb5ab0 Aug 19 21:15:18.807939 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-TestMinimumBasicScenario-1421082107-project Aug 19 21:15:18.807939 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: > Aug 19 21:15:18.807939 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Instance ea09e576-f3ee-4b10-813f-23574635c10c is not attached to volume ff854d78-15a0-44a4-a01f-3568c8d7f76f Aug 19 21:15:18.809455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'server_id': 'ea09e576-f3ee-4b10-813f-23574635c10c', 'id': 'ff854d78-15a0-44a4-a01f-3568c8d7f76f'} Aug 19 21:15:18.809455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:15:18.809455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:15:18.809455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 19 21:15:18.809455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 19 21:15:18.809455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 19 21:15:18.809455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 19 21:15:18.809455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 19 21:15:18.809455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 19 21:15:18.809455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ff854d78-15a0-44a4-a01f-3568c8d7f76f. Aug 19 21:15:18.809455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:18.809455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:15:18.809455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:18.809455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:15:18.809455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:15:18.809455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:15:18.809455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:15:18.809455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:15:18.809455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:15:18.811997 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:15:18.811997 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 19 21:15:18.811997 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 19 21:15:18.811997 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea09e576-f3ee-4b10-813f-23574635c10c is not attached to volume ff854d78-15a0-44a4-a01f-3568c8d7f76f Aug 19 21:15:18.811997 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:18.811997 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:15:18.811997 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:18.811997 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:15:18.811997 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:15:18.811997 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:15:18.811997 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:15:18.811997 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:15:18.811997 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea09e576-f3ee-4b10-813f-23574635c10c is not attached to volume ff854d78-15a0-44a4-a01f-3568c8d7f76f Aug 19 21:15:18.811997 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:18.811997 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-0ba041f3-9ed1-4015-bf65-aa3709990c5d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Returning 404 to user: Instance ea09e576-f3ee-4b10-813f-23574635c10c is not attached to volume ff854d78-15a0-44a4-a01f-3568c8d7f76f {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:15:18.814164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-0ba041f3-9ed1-4015-bf65-aa3709990c5d tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c/os-volume_attachments/ff854d78-15a0-44a4-a01f-3568c8d7f76f" status: 404 len: 154 microversion: 2.1 time: 0.129896 Aug 19 21:15:18.814164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 319/708] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Aug 19 21:15:18 2022] DELETE /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c/os-volume_attachments/ff854d78-15a0-44a4-a01f-3568c8d7f76f => generated 154 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:15:19.159831 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-09542c9d-5cb2-42f6-9ab2-6e0b035fced2 req-09ac7759-6711-4368-adbe-ed904b7bb953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5be0a3d-0419-4d69-83b2-22939e9c9bce", "tag": "eb7288c4-808b-4ef2-91d6-8f6c15db4227"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:15:19.170674 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-09542c9d-5cb2-42f6-9ab2-6e0b035fced2 req-09ac7759-6711-4368-adbe-ed904b7bb953 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:19.171355 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-09542c9d-5cb2-42f6-9ab2-6e0b035fced2 req-09ac7759-6711-4368-adbe-ed904b7bb953 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:19.172755 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-09542c9d-5cb2-42f6-9ab2-6e0b035fced2 req-09ac7759-6711-4368-adbe-ed904b7bb953 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:19.186090 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-09542c9d-5cb2-42f6-9ab2-6e0b035fced2 req-09ac7759-6711-4368-adbe-ed904b7bb953 service nova] Creating event network-changed:eb7288c4-808b-4ef2-91d6-8f6c15db4227 for instance e5be0a3d-0419-4d69-83b2-22939e9c9bce on hv-cinder-85220 Aug 19 21:15:19.191488 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-09542c9d-5cb2-42f6-9ab2-6e0b035fced2 req-09ac7759-6711-4368-adbe-ed904b7bb953 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035917 Aug 19 21:15:19.192104 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 390/709] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:15:19.627795 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-97ad70a1-f74a-43cc-8c43-7379003dbf67 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:19.631034 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-97ad70a1-f74a-43cc-8c43-7379003dbf67 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:19.639445 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-97ad70a1-f74a-43cc-8c43-7379003dbf67 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:19.639953 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-97ad70a1-f74a-43cc-8c43-7379003dbf67 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:19.640397 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-97ad70a1-f74a-43cc-8c43-7379003dbf67 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:19.641133 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-97ad70a1-f74a-43cc-8c43-7379003dbf67 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:19.641611 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-97ad70a1-f74a-43cc-8c43-7379003dbf67 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:19.642058 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-97ad70a1-f74a-43cc-8c43-7379003dbf67 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:19.679752 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-97ad70a1-f74a-43cc-8c43-7379003dbf67 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057994 Aug 19 21:15:19.680335 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 320/710] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Aug 19 21:15:19 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 21:15:19.779582 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-7adb0dc4-49fa-45af-9c7d-e8e134600e79 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:19.780520 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-7adb0dc4-49fa-45af-9c7d-e8e134600e79 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:19.787314 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7adb0dc4-49fa-45af-9c7d-e8e134600e79 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:19.788026 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7adb0dc4-49fa-45af-9c7d-e8e134600e79 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:19.789096 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7adb0dc4-49fa-45af-9c7d-e8e134600e79 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:19.790290 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7adb0dc4-49fa-45af-9c7d-e8e134600e79 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:19.790759 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7adb0dc4-49fa-45af-9c7d-e8e134600e79 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:19.791194 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7adb0dc4-49fa-45af-9c7d-e8e134600e79 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:19.819617 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-7adb0dc4-49fa-45af-9c7d-e8e134600e79 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Going to try to terminate instance {{(pid=120877) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 21:15:19.921092 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-7adb0dc4-49fa-45af-9c7d-e8e134600e79 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 204 len: 0 microversion: 2.1 time: 0.146064 Aug 19 21:15:19.921677 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 391/711] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:15:19 2022] DELETE /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 21:15:19.931476 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-5a201619-08f1-4d60-a32b-f11c22f9fa4c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:19.932095 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-5a201619-08f1-4d60-a32b-f11c22f9fa4c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:19.938818 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5a201619-08f1-4d60-a32b-f11c22f9fa4c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:19.939312 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5a201619-08f1-4d60-a32b-f11c22f9fa4c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:19.939745 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5a201619-08f1-4d60-a32b-f11c22f9fa4c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:19.940454 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5a201619-08f1-4d60-a32b-f11c22f9fa4c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:19.940909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5a201619-08f1-4d60-a32b-f11c22f9fa4c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:19.941337 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5a201619-08f1-4d60-a32b-f11c22f9fa4c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:19.976811 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-b52989ba-edeb-4292-8919-5c6b517ae3d4 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:19.977406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-b52989ba-edeb-4292-8919-5c6b517ae3d4 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:19.983815 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b52989ba-edeb-4292-8919-5c6b517ae3d4 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:19.984301 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b52989ba-edeb-4292-8919-5c6b517ae3d4 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:19.984834 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b52989ba-edeb-4292-8919-5c6b517ae3d4 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:19.985560 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b52989ba-edeb-4292-8919-5c6b517ae3d4 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:19.986037 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b52989ba-edeb-4292-8919-5c6b517ae3d4 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:19.986456 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b52989ba-edeb-4292-8919-5c6b517ae3d4 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:20.014245 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:20.032792 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-b52989ba-edeb-4292-8919-5c6b517ae3d4 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Going to try to terminate instance {{(pid=120877) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 21:15:20.095727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-5a201619-08f1-4d60-a32b-f11c22f9fa4c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:20.109080 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-5a201619-08f1-4d60-a32b-f11c22f9fa4c tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1688 microversion: 2.1 time: 0.182183 Aug 19 21:15:20.110277 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 321/712] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:19 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1688 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:20.128092 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-b52989ba-edeb-4292-8919-5c6b517ae3d4 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 204 len: 0 microversion: 2.1 time: 0.156023 Aug 19 21:15:20.128718 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 392/713] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:15:19 2022] DELETE /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 19 21:15:20.139063 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-7063fe39-440d-427f-a192-8915ef07c125 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:20.139989 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-7063fe39-440d-427f-a192-8915ef07c125 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:20.146722 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7063fe39-440d-427f-a192-8915ef07c125 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:20.147761 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7063fe39-440d-427f-a192-8915ef07c125 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:20.148496 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7063fe39-440d-427f-a192-8915ef07c125 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:20.149217 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7063fe39-440d-427f-a192-8915ef07c125 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:20.149678 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7063fe39-440d-427f-a192-8915ef07c125 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:20.150137 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7063fe39-440d-427f-a192-8915ef07c125 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:20.298663 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-7063fe39-440d-427f-a192-8915ef07c125 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:20.309798 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-7063fe39-440d-427f-a192-8915ef07c125 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1555 microversion: 2.1 time: 0.175736 Aug 19 21:15:20.310899 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 322/714] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:20 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1555 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:21.144689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-4e5861e8-19ad-4ea9-9ae2-494156d631d3 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:21.145404 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-4e5861e8-19ad-4ea9-9ae2-494156d631d3 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:21.153503 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4e5861e8-19ad-4ea9-9ae2-494156d631d3 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:21.154022 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4e5861e8-19ad-4ea9-9ae2-494156d631d3 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:21.154465 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4e5861e8-19ad-4ea9-9ae2-494156d631d3 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:21.155183 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4e5861e8-19ad-4ea9-9ae2-494156d631d3 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:21.155639 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4e5861e8-19ad-4ea9-9ae2-494156d631d3 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:21.156062 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4e5861e8-19ad-4ea9-9ae2-494156d631d3 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:21.336353 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-69be899a-8b4c-43e8-accf-2d6287a2b885 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:21.337581 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-69be899a-8b4c-43e8-accf-2d6287a2b885 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:21.347424 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-4e5861e8-19ad-4ea9-9ae2-494156d631d3 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:21.352441 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-69be899a-8b4c-43e8-accf-2d6287a2b885 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:21.353591 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-69be899a-8b4c-43e8-accf-2d6287a2b885 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:21.354346 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-69be899a-8b4c-43e8-accf-2d6287a2b885 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:21.355766 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-69be899a-8b4c-43e8-accf-2d6287a2b885 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:21.356968 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-69be899a-8b4c-43e8-accf-2d6287a2b885 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:21.358024 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-69be899a-8b4c-43e8-accf-2d6287a2b885 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:21.362769 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-4e5861e8-19ad-4ea9-9ae2-494156d631d3 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1688 microversion: 2.1 time: 0.222600 Aug 19 21:15:21.364169 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 393/715] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:21 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1688 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:21.529837 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-69be899a-8b4c-43e8-accf-2d6287a2b885 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:21.537917 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-69be899a-8b4c-43e8-accf-2d6287a2b885 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1555 microversion: 2.1 time: 0.208372 Aug 19 21:15:21.538507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 323/716] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:21 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1555 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:22.384500 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-9bfb2539-0f99-4914-8051-fdb99d01d3dd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:22.385051 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-9bfb2539-0f99-4914-8051-fdb99d01d3dd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:22.392149 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9bfb2539-0f99-4914-8051-fdb99d01d3dd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:22.392630 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9bfb2539-0f99-4914-8051-fdb99d01d3dd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:22.393063 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9bfb2539-0f99-4914-8051-fdb99d01d3dd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:22.393787 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9bfb2539-0f99-4914-8051-fdb99d01d3dd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:22.394241 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9bfb2539-0f99-4914-8051-fdb99d01d3dd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:22.394657 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9bfb2539-0f99-4914-8051-fdb99d01d3dd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:22.557314 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-9bfb2539-0f99-4914-8051-fdb99d01d3dd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:22.561952 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-87c85b2c-fc86-4e4b-86af-8c8db7f7476c tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:22.562893 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-87c85b2c-fc86-4e4b-86af-8c8db7f7476c tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:22.571924 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-9bfb2539-0f99-4914-8051-fdb99d01d3dd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1688 microversion: 2.1 time: 0.191011 Aug 19 21:15:22.572884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 394/717] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:22 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1688 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:22.573328 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-87c85b2c-fc86-4e4b-86af-8c8db7f7476c tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:22.574037 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-87c85b2c-fc86-4e4b-86af-8c8db7f7476c tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:22.574573 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-87c85b2c-fc86-4e4b-86af-8c8db7f7476c tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:22.575373 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-87c85b2c-fc86-4e4b-86af-8c8db7f7476c tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:22.575914 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-87c85b2c-fc86-4e4b-86af-8c8db7f7476c tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:22.576424 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-87c85b2c-fc86-4e4b-86af-8c8db7f7476c tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:22.741907 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-87c85b2c-fc86-4e4b-86af-8c8db7f7476c tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:22.752866 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-87c85b2c-fc86-4e4b-86af-8c8db7f7476c tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1555 microversion: 2.1 time: 0.197361 Aug 19 21:15:22.753834 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 324/718] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:22 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1555 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:23.594660 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-51cbc0aa-7075-4068-a2c9-79b4f258d111 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:23.595310 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-51cbc0aa-7075-4068-a2c9-79b4f258d111 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:23.602166 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-51cbc0aa-7075-4068-a2c9-79b4f258d111 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:23.602708 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-51cbc0aa-7075-4068-a2c9-79b4f258d111 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:23.603321 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-51cbc0aa-7075-4068-a2c9-79b4f258d111 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:23.604031 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-51cbc0aa-7075-4068-a2c9-79b4f258d111 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:23.604481 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-51cbc0aa-7075-4068-a2c9-79b4f258d111 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:23.604905 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-51cbc0aa-7075-4068-a2c9-79b4f258d111 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:23.775696 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-51cbc0aa-7075-4068-a2c9-79b4f258d111 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:23.782143 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-27159dc7-7eed-49f0-b1dc-6396fac6a7c7 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:23.784220 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-27159dc7-7eed-49f0-b1dc-6396fac6a7c7 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:23.785330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-51cbc0aa-7075-4068-a2c9-79b4f258d111 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1688 microversion: 2.1 time: 0.194460 Aug 19 21:15:23.786118 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 395/719] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:23 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1688 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:15:23.796152 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-27159dc7-7eed-49f0-b1dc-6396fac6a7c7 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:23.796890 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-27159dc7-7eed-49f0-b1dc-6396fac6a7c7 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:23.797530 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-27159dc7-7eed-49f0-b1dc-6396fac6a7c7 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:23.798524 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-27159dc7-7eed-49f0-b1dc-6396fac6a7c7 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:23.799153 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-27159dc7-7eed-49f0-b1dc-6396fac6a7c7 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:23.799710 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-27159dc7-7eed-49f0-b1dc-6396fac6a7c7 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:23.981181 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-27159dc7-7eed-49f0-b1dc-6396fac6a7c7 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:23.989867 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-27159dc7-7eed-49f0-b1dc-6396fac6a7c7 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1555 microversion: 2.1 time: 0.212588 Aug 19 21:15:23.991731 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 325/720] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:23 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1555 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:24.810522 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a76ff919-5e29-4e00-9697-af210b619602 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:24.811075 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-a76ff919-5e29-4e00-9697-af210b619602 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:24.818129 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a76ff919-5e29-4e00-9697-af210b619602 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:24.819470 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a76ff919-5e29-4e00-9697-af210b619602 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:24.820025 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a76ff919-5e29-4e00-9697-af210b619602 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:24.820719 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a76ff919-5e29-4e00-9697-af210b619602 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:24.821169 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a76ff919-5e29-4e00-9697-af210b619602 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:24.821585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a76ff919-5e29-4e00-9697-af210b619602 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:24.965738 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-a76ff919-5e29-4e00-9697-af210b619602 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:24.973668 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-a76ff919-5e29-4e00-9697-af210b619602 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1688 microversion: 2.1 time: 0.167054 Aug 19 21:15:24.974287 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 396/721] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:24 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:25.014127 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-7e704998-203a-4061-a7a0-4e6fe408f244 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:25.014865 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-7e704998-203a-4061-a7a0-4e6fe408f244 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:25.017831 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:25.024582 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7e704998-203a-4061-a7a0-4e6fe408f244 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:25.025094 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7e704998-203a-4061-a7a0-4e6fe408f244 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:25.025507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7e704998-203a-4061-a7a0-4e6fe408f244 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:25.026249 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7e704998-203a-4061-a7a0-4e6fe408f244 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:25.026701 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7e704998-203a-4061-a7a0-4e6fe408f244 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:25.027121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7e704998-203a-4061-a7a0-4e6fe408f244 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:25.185660 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-7e704998-203a-4061-a7a0-4e6fe408f244 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:25.194841 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-7e704998-203a-4061-a7a0-4e6fe408f244 tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1555 microversion: 2.1 time: 0.184939 Aug 19 21:15:25.195455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 326/722] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:25 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1555 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:25.995886 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-68e3c665-78f3-461d-946c-93b0e3ddfc82 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:25.996499 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-68e3c665-78f3-461d-946c-93b0e3ddfc82 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:26.003875 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-68e3c665-78f3-461d-946c-93b0e3ddfc82 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:26.004689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-68e3c665-78f3-461d-946c-93b0e3ddfc82 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:26.005154 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-68e3c665-78f3-461d-946c-93b0e3ddfc82 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:26.005924 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-68e3c665-78f3-461d-946c-93b0e3ddfc82 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:26.006605 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-68e3c665-78f3-461d-946c-93b0e3ddfc82 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:26.007110 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-68e3c665-78f3-461d-946c-93b0e3ddfc82 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:26.128039 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-68e3c665-78f3-461d-946c-93b0e3ddfc82 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:26.141989 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-68e3c665-78f3-461d-946c-93b0e3ddfc82 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 200 len: 1621 microversion: 2.1 time: 0.149732 Aug 19 21:15:26.142892 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 397/723] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:25 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 1621 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:26.200768 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-47c155cc-3a78-43c4-85da-14b67777172c req-bdf4f6d5-05d3-4040-8f5b-edb9890b8556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea09e576-f3ee-4b10-813f-23574635c10c", "name": "network-vif-deleted", "tag": "dc06a7d7-d9fe-4dd6-8dab-d1c3f12f11f3"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:15:26.219434 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-28f3cd28-db82-42a6-93e9-0a316c40ce9c tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:26.220120 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-28f3cd28-db82-42a6-93e9-0a316c40ce9c tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:26.236018 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-28f3cd28-db82-42a6-93e9-0a316c40ce9c tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:26.236516 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-28f3cd28-db82-42a6-93e9-0a316c40ce9c tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:26.238672 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-28f3cd28-db82-42a6-93e9-0a316c40ce9c tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:26.239458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-28f3cd28-db82-42a6-93e9-0a316c40ce9c tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:26.239939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-28f3cd28-db82-42a6-93e9-0a316c40ce9c tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:26.240381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-28f3cd28-db82-42a6-93e9-0a316c40ce9c tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:26.260913 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-47c155cc-3a78-43c4-85da-14b67777172c req-bdf4f6d5-05d3-4040-8f5b-edb9890b8556 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:26.262245 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-47c155cc-3a78-43c4-85da-14b67777172c req-bdf4f6d5-05d3-4040-8f5b-edb9890b8556 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:26.262960 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-47c155cc-3a78-43c4-85da-14b67777172c req-bdf4f6d5-05d3-4040-8f5b-edb9890b8556 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:26.284894 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-47c155cc-3a78-43c4-85da-14b67777172c req-bdf4f6d5-05d3-4040-8f5b-edb9890b8556 service nova] Creating event network-vif-deleted:dc06a7d7-d9fe-4dd6-8dab-d1c3f12f11f3 for instance ea09e576-f3ee-4b10-813f-23574635c10c on hv-cinder-85220 Aug 19 21:15:26.293988 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-47c155cc-3a78-43c4-85da-14b67777172c req-bdf4f6d5-05d3-4040-8f5b-edb9890b8556 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104774 Aug 19 21:15:26.295557 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 327/724] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:15:26.304615 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-2782dc7d-a2a0-4711-abb3-c3b646807344 req-59374631-0980-4982-b9f7-d5f8607e347d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7df3ead0-b255-4b0c-8fa7-f9ae80138539", "name": "network-vif-deleted", "tag": "3a4cbe7a-9f6d-4454-9ea2-92df8cfb98b9"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:15:26.316872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-2782dc7d-a2a0-4711-abb3-c3b646807344 req-59374631-0980-4982-b9f7-d5f8607e347d service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:26.318074 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-2782dc7d-a2a0-4711-abb3-c3b646807344 req-59374631-0980-4982-b9f7-d5f8607e347d service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:26.319608 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-2782dc7d-a2a0-4711-abb3-c3b646807344 req-59374631-0980-4982-b9f7-d5f8607e347d service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:26.355705 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-2782dc7d-a2a0-4711-abb3-c3b646807344 req-59374631-0980-4982-b9f7-d5f8607e347d service nova] Creating event network-vif-deleted:3a4cbe7a-9f6d-4454-9ea2-92df8cfb98b9 for instance 7df3ead0-b255-4b0c-8fa7-f9ae80138539 on hv-cinder-85220 Aug 19 21:15:26.382646 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-2782dc7d-a2a0-4711-abb3-c3b646807344 req-59374631-0980-4982-b9f7-d5f8607e347d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083775 Aug 19 21:15:26.388808 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 328/725] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:15:26.406422 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-28f3cd28-db82-42a6-93e9-0a316c40ce9c tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90472736cbcf497c89f0ae1582bb5ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf734543b7e0426d93654f18f0d98e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:26.447661 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-28f3cd28-db82-42a6-93e9-0a316c40ce9c tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 200 len: 1513 microversion: 2.1 time: 0.232803 Aug 19 21:15:26.455181 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 398/726] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:26 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 1513 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:15:27.187849 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-77108479-6679-4065-bbc0-2baaea061902 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:27.188664 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-77108479-6679-4065-bbc0-2baaea061902 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: 7df3ead0-b255-4b0c-8fa7-f9ae80138539] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:27.198293 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-77108479-6679-4065-bbc0-2baaea061902 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:27.204689 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-77108479-6679-4065-bbc0-2baaea061902 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:27.205702 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-77108479-6679-4065-bbc0-2baaea061902 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:27.206246 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-77108479-6679-4065-bbc0-2baaea061902 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:27.206813 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-77108479-6679-4065-bbc0-2baaea061902 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:27.207536 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-77108479-6679-4065-bbc0-2baaea061902 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:27.229052 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-77108479-6679-4065-bbc0-2baaea061902 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] HTTP exception thrown: Instance 7df3ead0-b255-4b0c-8fa7-f9ae80138539 could not be found. Aug 19 21:15:27.231686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-77108479-6679-4065-bbc0-2baaea061902 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Request method failure captured: Aug 19 21:15:27.231686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 HTTP/1.1 Aug 19 21:15:27.231686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:15:27.231686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:15:27.231686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:15:27.231686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:15:27.231686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:15:27.231686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:15:27.231686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:15:27.231686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:15:27.231686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__u_fqu6__XAfEE8we4aMURTivVATLB4jAgDmOFji8LAe6kA4gLjm1nrouNEf5jjDjNj26q2gqZM2Is0Dwmcg8wVlRCJeDOlaq0WksfDdNjKfw7dq4UB7lXlKAtdfsuLSIAySQq0SR_EwssRHXqVK43vCJaIMBR00xJyCTcakpc4R8U Aug 19 21:15:27.231686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:15:27.231686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:15:27.231686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:15:27.231686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:15:27.231686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:15:27.231686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:15:27.231686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: 1c4004ba973b4454865b889d6d1e049a Aug 19 21:15:27.231686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1218485444 Aug 19 21:15:27.231686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:15:27.231686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:15:27.233165 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1c4004ba973b4454865b889d6d1e049a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c4004ba973b4454865b889d6d1e049a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1c4004ba973b4454865b889d6d1e049a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c4004ba973b4454865b889d6d1e049a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:15:27.233165 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1218485444 Aug 19 21:15:27.233165 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: 1c4004ba973b4454865b889d6d1e049a Aug 19 21:15:27.233165 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1218485444 Aug 19 21:15:27.233165 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-ServerRescueNegativeTestJSON-1218485444-project Aug 19 21:15:27.233165 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:15:27.233165 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:15:27.233165 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: e8e345dbc2114b718c98c70844352c63 Aug 19 21:15:27.233165 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1218485444-project Aug 19 21:15:27.233165 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: > Aug 19 21:15:27.233165 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Instance 7df3ead0-b255-4b0c-8fa7-f9ae80138539 could not be found. Aug 19 21:15:27.233165 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': '7df3ead0-b255-4b0c-8fa7-f9ae80138539'} Aug 19 21:15:27.233963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:15:27.233963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:15:27.233963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:15:27.233963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:15:27.233963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:15:27.233963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:15:27.233963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:15:27.233963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:15:27.233963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:15:27.233963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:15:27.233963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7df3ead0-b255-4b0c-8fa7-f9ae80138539 could not be found. Aug 19 21:15:27.233963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:27.233963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:15:27.233963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:27.233963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:15:27.233963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:15:27.233963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:15:27.233963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:15:27.233963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:15:27.233963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:15:27.235229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:15:27.235229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:15:27.235229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:15:27.235229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:15:27.235229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:15:27.235229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:15:27.235229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:15:27.235229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7df3ead0-b255-4b0c-8fa7-f9ae80138539 could not be found. Aug 19 21:15:27.235229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:27.235229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:15:27.235229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:27.235229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:15:27.235229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:15:27.235229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:15:27.235229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:15:27.235229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:15:27.235229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7df3ead0-b255-4b0c-8fa7-f9ae80138539 could not be found. Aug 19 21:15:27.235229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:27.239621 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-77108479-6679-4065-bbc0-2baaea061902 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Returning 404 to user: Instance 7df3ead0-b255-4b0c-8fa7-f9ae80138539 could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:15:27.241501 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-77108479-6679-4065-bbc0-2baaea061902 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539" status: 404 len: 111 microversion: 2.1 time: 0.065963 Aug 19 21:15:27.242405 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 329/727] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:27 2022] GET /compute/v2.1/servers/7df3ead0-b255-4b0c-8fa7-f9ae80138539 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:15:27.255898 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-34cf6fbe-6247-4eaf-9a6a-69031398532e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '.version_select at 0x7f740bbaeaf0>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:27.278711 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-34cf6fbe-6247-4eaf-9a6a-69031398532e tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-738933856" status: 202 len: 0 microversion: 2.1 time: 0.028000 Aug 19 21:15:27.279334 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 399/728] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Aug 19 21:15:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-738933856 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:15:27.493185 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-8f514f45-0568-475e-a6a0-26a126e292ef tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:27.494817 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-8f514f45-0568-475e-a6a0-26a126e292ef tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] [instance: ea09e576-f3ee-4b10-813f-23574635c10c] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:27.507667 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8f514f45-0568-475e-a6a0-26a126e292ef tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:27.509144 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8f514f45-0568-475e-a6a0-26a126e292ef tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:27.510310 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8f514f45-0568-475e-a6a0-26a126e292ef tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:27.512368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8f514f45-0568-475e-a6a0-26a126e292ef tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:27.513579 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8f514f45-0568-475e-a6a0-26a126e292ef tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:27.515013 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8f514f45-0568-475e-a6a0-26a126e292ef tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:27.543665 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-8f514f45-0568-475e-a6a0-26a126e292ef tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] HTTP exception thrown: Instance ea09e576-f3ee-4b10-813f-23574635c10c could not be found. Aug 19 21:15:27.547035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-8f514f45-0568-475e-a6a0-26a126e292ef tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Request method failure captured: Aug 19 21:15:27.547035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c HTTP/1.1 Aug 19 21:15:27.547035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:15:27.547035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:15:27.547035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:15:27.547035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:15:27.547035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:15:27.547035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:15:27.547035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:15:27.547035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:15:27.547035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__xoTzI0YJ7DxoEXvWeaRwS9XcShMbVMfNVExPjcjrAAW1B5G0QA6E0UsAmeEtv09IqHk5kVvdPB64FYTnqMqGMfJ1wOLFi62i-APWPluUnnQfFGzJfiQ5BzSOTjCApYODDDUTG4A6r-sZdVcVwUduns-ixw3HREMaT9gkT5BydPxpk Aug 19 21:15:27.547035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:15:27.547035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:15:27.547035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:15:27.547035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:15:27.547035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:15:27.547035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:15:27.547035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: cf734543b7e0426d93654f18f0d98e4a Aug 19 21:15:27.547035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-TestMinimumBasicScenario-1421082107 Aug 19 21:15:27.547035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:15:27.547035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:15:27.549481 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf734543b7e0426d93654f18f0d98e4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf734543b7e0426d93654f18f0d98e4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf734543b7e0426d93654f18f0d98e4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf734543b7e0426d93654f18f0d98e4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:15:27.549481 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-TestMinimumBasicScenario-1421082107 Aug 19 21:15:27.549481 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: cf734543b7e0426d93654f18f0d98e4a Aug 19 21:15:27.549481 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1421082107 Aug 19 21:15:27.549481 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-TestMinimumBasicScenario-1421082107-project Aug 19 21:15:27.549481 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:15:27.549481 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:15:27.549481 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: 90472736cbcf497c89f0ae1582bb5ab0 Aug 19 21:15:27.549481 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-TestMinimumBasicScenario-1421082107-project Aug 19 21:15:27.549481 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: > Aug 19 21:15:27.549481 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Instance ea09e576-f3ee-4b10-813f-23574635c10c could not be found. Aug 19 21:15:27.549481 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': 'ea09e576-f3ee-4b10-813f-23574635c10c'} Aug 19 21:15:27.550945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:15:27.550945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:15:27.550945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:15:27.550945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:15:27.550945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:15:27.550945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:15:27.550945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:15:27.550945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:15:27.550945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:15:27.550945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:15:27.550945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea09e576-f3ee-4b10-813f-23574635c10c could not be found. Aug 19 21:15:27.550945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:27.550945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:15:27.550945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:27.550945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:15:27.550945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:15:27.550945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:15:27.550945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:15:27.550945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:15:27.550945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:15:27.553714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:15:27.553714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:15:27.553714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:15:27.553714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:15:27.553714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:15:27.553714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:15:27.553714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:15:27.553714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea09e576-f3ee-4b10-813f-23574635c10c could not be found. Aug 19 21:15:27.553714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:27.553714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:15:27.553714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:27.553714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:15:27.553714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:15:27.553714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:15:27.553714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:15:27.553714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:15:27.553714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea09e576-f3ee-4b10-813f-23574635c10c could not be found. Aug 19 21:15:27.553714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:27.558571 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-8f514f45-0568-475e-a6a0-26a126e292ef tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Returning 404 to user: Instance ea09e576-f3ee-4b10-813f-23574635c10c could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:15:27.558571 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-8f514f45-0568-475e-a6a0-26a126e292ef tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c" status: 404 len: 111 microversion: 2.1 time: 0.063610 Aug 19 21:15:27.558571 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 330/729] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:27 2022] GET /compute/v2.1/servers/ea09e576-f3ee-4b10-813f-23574635c10c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:15:27.566738 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-6a327f8d-129a-4121-b3b1-5ad82f52065a tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] Calling method '.version_select at 0x7f740bb65790>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:27.613739 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-6a327f8d-129a-4121-b3b1-5ad82f52065a tempest-TestMinimumBasicScenario-1421082107 tempest-TestMinimumBasicScenario-1421082107-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2057503836" status: 202 len: 0 microversion: 2.1 time: 0.055020 Aug 19 21:15:27.615492 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 400/730] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Aug 19 21:15:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2057503836 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:15:30.633036 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-baa88d06-f194-4c29-ba18-359c9a8c90bf tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:30.633886 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-baa88d06-f194-4c29-ba18-359c9a8c90bf tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:30.642909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-baa88d06-f194-4c29-ba18-359c9a8c90bf tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:30.643750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-baa88d06-f194-4c29-ba18-359c9a8c90bf tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:30.652101 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-baa88d06-f194-4c29-ba18-359c9a8c90bf tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:30.652890 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-baa88d06-f194-4c29-ba18-359c9a8c90bf tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:30.653359 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-baa88d06-f194-4c29-ba18-359c9a8c90bf tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:30.653812 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-baa88d06-f194-4c29-ba18-359c9a8c90bf tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:30.685254 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-baa88d06-f194-4c29-ba18-359c9a8c90bf tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Going to try to terminate instance {{(pid=120876) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 21:15:30.774993 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-baa88d06-f194-4c29-ba18-359c9a8c90bf tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 204 len: 0 microversion: 2.1 time: 0.146578 Aug 19 21:15:30.775895 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 331/731] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:15:30 2022] DELETE /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 19 21:15:30.785331 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-477c0895-1a64-401e-b96b-af57eba0b6fd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:30.785999 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-477c0895-1a64-401e-b96b-af57eba0b6fd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:30.793405 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-477c0895-1a64-401e-b96b-af57eba0b6fd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:30.794236 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-477c0895-1a64-401e-b96b-af57eba0b6fd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:30.794750 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-477c0895-1a64-401e-b96b-af57eba0b6fd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:30.795699 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-477c0895-1a64-401e-b96b-af57eba0b6fd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:30.796169 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-477c0895-1a64-401e-b96b-af57eba0b6fd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:30.796595 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-477c0895-1a64-401e-b96b-af57eba0b6fd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:31.258656 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-477c0895-1a64-401e-b96b-af57eba0b6fd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:31.268252 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-477c0895-1a64-401e-b96b-af57eba0b6fd tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1507 microversion: 2.1 time: 0.487764 Aug 19 21:15:31.268934 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 401/732] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:30 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1507 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:32.185017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-a3545358-2fe3-4a07-addb-f7512ed1f1ce req-045c480c-2567-4f3d-b2e5-791a26a3332f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeac61e2-44ff-4477-94da-a109f4907096", "name": "network-vif-deleted", "tag": "554843a8-960c-4d22-858b-254efc47fd8c"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:15:32.221488 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-a3545358-2fe3-4a07-addb-f7512ed1f1ce req-045c480c-2567-4f3d-b2e5-791a26a3332f service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:32.222182 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-a3545358-2fe3-4a07-addb-f7512ed1f1ce req-045c480c-2567-4f3d-b2e5-791a26a3332f service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:32.222725 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-a3545358-2fe3-4a07-addb-f7512ed1f1ce req-045c480c-2567-4f3d-b2e5-791a26a3332f service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:32.240218 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-a3545358-2fe3-4a07-addb-f7512ed1f1ce req-045c480c-2567-4f3d-b2e5-791a26a3332f service nova] Creating event network-vif-deleted:554843a8-960c-4d22-858b-254efc47fd8c for instance eeac61e2-44ff-4477-94da-a109f4907096 on hv-cinder-85220 Aug 19 21:15:32.246853 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-a3545358-2fe3-4a07-addb-f7512ed1f1ce req-045c480c-2567-4f3d-b2e5-791a26a3332f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070914 Aug 19 21:15:32.247911 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 332/733] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:15:32.297565 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-52362a9c-04cf-416f-9a0d-e8f8aca5d8af tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:32.298244 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-52362a9c-04cf-416f-9a0d-e8f8aca5d8af tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:32.314184 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-52362a9c-04cf-416f-9a0d-e8f8aca5d8af tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:32.314910 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-52362a9c-04cf-416f-9a0d-e8f8aca5d8af tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:32.315359 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-52362a9c-04cf-416f-9a0d-e8f8aca5d8af tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:32.316703 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-52362a9c-04cf-416f-9a0d-e8f8aca5d8af tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:32.317239 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-52362a9c-04cf-416f-9a0d-e8f8aca5d8af tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:32.317672 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-52362a9c-04cf-416f-9a0d-e8f8aca5d8af tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:32.363595 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-52362a9c-04cf-416f-9a0d-e8f8aca5d8af tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:32.364148 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-52362a9c-04cf-416f-9a0d-e8f8aca5d8af tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:32.365092 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-52362a9c-04cf-416f-9a0d-e8f8aca5d8af tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:32.365193 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.objects.instance [None req-52362a9c-04cf-416f-9a0d-e8f8aca5d8af tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lazy-loading 'fault' on Instance uuid eeac61e2-44ff-4477-94da-a109f4907096 {{(pid=120877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:15:32.417105 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-52362a9c-04cf-416f-9a0d-e8f8aca5d8af tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:32.425450 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-52362a9c-04cf-416f-9a0d-e8f8aca5d8af tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 200 len: 1311 microversion: 2.1 time: 0.139181 Aug 19 21:15:32.430044 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 402/734] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:32 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 1311 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:33.448935 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-88956c22-dc67-4d6f-a7d7-70be56b8fcbb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:33.449828 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-88956c22-dc67-4d6f-a7d7-70be56b8fcbb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: eeac61e2-44ff-4477-94da-a109f4907096] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:33.457478 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-88956c22-dc67-4d6f-a7d7-70be56b8fcbb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:33.458161 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-88956c22-dc67-4d6f-a7d7-70be56b8fcbb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:33.458703 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-88956c22-dc67-4d6f-a7d7-70be56b8fcbb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:33.460252 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-88956c22-dc67-4d6f-a7d7-70be56b8fcbb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:33.460998 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-88956c22-dc67-4d6f-a7d7-70be56b8fcbb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:33.461526 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-88956c22-dc67-4d6f-a7d7-70be56b8fcbb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:33.479577 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-88956c22-dc67-4d6f-a7d7-70be56b8fcbb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] HTTP exception thrown: Instance eeac61e2-44ff-4477-94da-a109f4907096 could not be found. Aug 19 21:15:33.481674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-88956c22-dc67-4d6f-a7d7-70be56b8fcbb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Request method failure captured: Aug 19 21:15:33.481674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 HTTP/1.1 Aug 19 21:15:33.481674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:15:33.481674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:15:33.481674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:15:33.481674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:15:33.481674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:15:33.481674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:15:33.481674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:15:33.481674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:15:33.481674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__u_fqu6__XAfEE8we4aMURTivVATLB4jAgDmOFji8LAe6kA4gLjm1nrouNEf5jjDjNj26q2gqZM2Is0Dwmcg8wVlRCJeDOlaq0WksfDdNjKfw7dq4UB7lXlKAtdfsuLSIAySQq0SR_EwssRHXqVK43vCJaIMBR00xJyCTcakpc4R8U Aug 19 21:15:33.481674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:15:33.481674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:15:33.481674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:15:33.481674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:15:33.481674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:15:33.481674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:15:33.481674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: 1c4004ba973b4454865b889d6d1e049a Aug 19 21:15:33.481674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1218485444 Aug 19 21:15:33.481674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:15:33.481674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:15:33.483229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1c4004ba973b4454865b889d6d1e049a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c4004ba973b4454865b889d6d1e049a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1c4004ba973b4454865b889d6d1e049a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c4004ba973b4454865b889d6d1e049a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:15:33.483229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1218485444 Aug 19 21:15:33.483229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: 1c4004ba973b4454865b889d6d1e049a Aug 19 21:15:33.483229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1218485444 Aug 19 21:15:33.483229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-ServerRescueNegativeTestJSON-1218485444-project Aug 19 21:15:33.483229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:15:33.483229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:15:33.483229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: e8e345dbc2114b718c98c70844352c63 Aug 19 21:15:33.483229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1218485444-project Aug 19 21:15:33.483229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: > Aug 19 21:15:33.483229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Instance eeac61e2-44ff-4477-94da-a109f4907096 could not be found. Aug 19 21:15:33.483229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': 'eeac61e2-44ff-4477-94da-a109f4907096'} Aug 19 21:15:33.483978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:15:33.483978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:15:33.483978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:15:33.483978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:15:33.483978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:15:33.483978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:15:33.483978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:15:33.483978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:15:33.483978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:15:33.483978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:15:33.483978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeac61e2-44ff-4477-94da-a109f4907096 could not be found. Aug 19 21:15:33.483978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:33.483978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:15:33.483978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:33.483978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:15:33.483978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:15:33.483978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:15:33.483978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:15:33.483978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:15:33.483978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:15:33.485201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:15:33.485201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:15:33.485201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:15:33.485201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:15:33.485201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:15:33.485201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:15:33.485201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:15:33.485201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeac61e2-44ff-4477-94da-a109f4907096 could not be found. Aug 19 21:15:33.485201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:33.485201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:15:33.485201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:33.485201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:15:33.485201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:15:33.485201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:15:33.485201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:15:33.485201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:15:33.485201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeac61e2-44ff-4477-94da-a109f4907096 could not be found. Aug 19 21:15:33.485201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:33.486343 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-88956c22-dc67-4d6f-a7d7-70be56b8fcbb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Returning 404 to user: Instance eeac61e2-44ff-4477-94da-a109f4907096 could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:15:33.486343 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-88956c22-dc67-4d6f-a7d7-70be56b8fcbb tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096" status: 404 len: 111 microversion: 2.1 time: 0.041385 Aug 19 21:15:33.489949 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 333/735] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:33 2022] GET /compute/v2.1/servers/eeac61e2-44ff-4477-94da-a109f4907096 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:15:33.495410 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-04214da5-6065-43dd-a017-7555c4c63663 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:33.496045 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-04214da5-6065-43dd-a017-7555c4c63663 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:33.509025 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-04214da5-6065-43dd-a017-7555c4c63663 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:33.509025 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-04214da5-6065-43dd-a017-7555c4c63663 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:33.509025 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-04214da5-6065-43dd-a017-7555c4c63663 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:33.509025 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-04214da5-6065-43dd-a017-7555c4c63663 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:33.509645 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-04214da5-6065-43dd-a017-7555c4c63663 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:33.509645 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-04214da5-6065-43dd-a017-7555c4c63663 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:33.540369 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-04214da5-6065-43dd-a017-7555c4c63663 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Going to try to terminate instance {{(pid=120877) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 21:15:33.645787 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-04214da5-6065-43dd-a017-7555c4c63663 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 204 len: 0 microversion: 2.1 time: 0.150086 Aug 19 21:15:33.647540 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 403/736] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:15:33 2022] DELETE /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 21:15:33.658112 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-348aef8a-c8c0-4046-8fe3-6e1a9ff07229 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:33.659118 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-348aef8a-c8c0-4046-8fe3-6e1a9ff07229 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:33.674289 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-348aef8a-c8c0-4046-8fe3-6e1a9ff07229 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:33.674877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-348aef8a-c8c0-4046-8fe3-6e1a9ff07229 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:33.675388 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-348aef8a-c8c0-4046-8fe3-6e1a9ff07229 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:33.676226 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-348aef8a-c8c0-4046-8fe3-6e1a9ff07229 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:33.676791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-348aef8a-c8c0-4046-8fe3-6e1a9ff07229 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:33.677393 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-348aef8a-c8c0-4046-8fe3-6e1a9ff07229 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:33.896229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-348aef8a-c8c0-4046-8fe3-6e1a9ff07229 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:33.905144 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-348aef8a-c8c0-4046-8fe3-6e1a9ff07229 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1520 microversion: 2.1 time: 0.251522 Aug 19 21:15:33.906079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 334/737] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:33 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:34.927355 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-2326b1ab-68ba-449d-9a2a-90b2769fcdfa tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:34.928643 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-2326b1ab-68ba-449d-9a2a-90b2769fcdfa tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:34.935342 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2326b1ab-68ba-449d-9a2a-90b2769fcdfa tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:34.935833 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2326b1ab-68ba-449d-9a2a-90b2769fcdfa tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:34.936294 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2326b1ab-68ba-449d-9a2a-90b2769fcdfa tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:34.937002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2326b1ab-68ba-449d-9a2a-90b2769fcdfa tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:34.937561 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2326b1ab-68ba-449d-9a2a-90b2769fcdfa tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:34.937930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2326b1ab-68ba-449d-9a2a-90b2769fcdfa tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:35.104904 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-2326b1ab-68ba-449d-9a2a-90b2769fcdfa tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:35.112782 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-2326b1ab-68ba-449d-9a2a-90b2769fcdfa tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1520 microversion: 2.1 time: 0.189670 Aug 19 21:15:35.114491 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 404/738] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:34 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:36.136293 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-e9e7c46d-470b-4f70-bf3c-d3d1eb385d17 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:36.137412 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-e9e7c46d-470b-4f70-bf3c-d3d1eb385d17 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:36.145234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e9e7c46d-470b-4f70-bf3c-d3d1eb385d17 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:36.145902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e9e7c46d-470b-4f70-bf3c-d3d1eb385d17 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:36.146365 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e9e7c46d-470b-4f70-bf3c-d3d1eb385d17 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:36.147290 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e9e7c46d-470b-4f70-bf3c-d3d1eb385d17 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:36.147901 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e9e7c46d-470b-4f70-bf3c-d3d1eb385d17 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:36.148520 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e9e7c46d-470b-4f70-bf3c-d3d1eb385d17 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:36.303976 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-e9e7c46d-470b-4f70-bf3c-d3d1eb385d17 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e345dbc2114b718c98c70844352c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4004ba973b4454865b889d6d1e049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:36.311758 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-e9e7c46d-470b-4f70-bf3c-d3d1eb385d17 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 200 len: 1520 microversion: 2.1 time: 0.179560 Aug 19 21:15:36.327604 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 335/739] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:36 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:36.423361 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-5c103cc9-a00a-462f-9e20-e029c733f6ce req-f289a2d7-5661-4eb4-8505-18f11c0a73a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e363b06b-e5dd-48c8-a0d8-afdfa5bad759", "name": "network-vif-deleted", "tag": "851487e1-a850-4116-9209-d8a95dd86a4e"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:15:36.436051 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-5c103cc9-a00a-462f-9e20-e029c733f6ce req-f289a2d7-5661-4eb4-8505-18f11c0a73a7 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:36.437985 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-5c103cc9-a00a-462f-9e20-e029c733f6ce req-f289a2d7-5661-4eb4-8505-18f11c0a73a7 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:36.437985 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-5c103cc9-a00a-462f-9e20-e029c733f6ce req-f289a2d7-5661-4eb4-8505-18f11c0a73a7 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:36.453567 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-5c103cc9-a00a-462f-9e20-e029c733f6ce req-f289a2d7-5661-4eb4-8505-18f11c0a73a7 service nova] Creating event network-vif-deleted:851487e1-a850-4116-9209-d8a95dd86a4e for instance e363b06b-e5dd-48c8-a0d8-afdfa5bad759 on hv-cinder-85220 Aug 19 21:15:36.464330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-5c103cc9-a00a-462f-9e20-e029c733f6ce req-f289a2d7-5661-4eb4-8505-18f11c0a73a7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046532 Aug 19 21:15:36.465660 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 405/740] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:15:37.098655 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-5650a135-6262-4cc2-a14e-caf3ee058d57 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:37.101773 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-5650a135-6262-4cc2-a14e-caf3ee058d57 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:37.107625 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5650a135-6262-4cc2-a14e-caf3ee058d57 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:37.108109 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5650a135-6262-4cc2-a14e-caf3ee058d57 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:37.108541 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5650a135-6262-4cc2-a14e-caf3ee058d57 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:37.109233 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5650a135-6262-4cc2-a14e-caf3ee058d57 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:37.109682 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5650a135-6262-4cc2-a14e-caf3ee058d57 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:37.110194 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5650a135-6262-4cc2-a14e-caf3ee058d57 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:37.142265 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-5650a135-6262-4cc2-a14e-caf3ee058d57 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047422 Aug 19 21:15:37.143319 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 336/741] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Aug 19 21:15:37 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 21:15:37.211427 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-5605123d-c431-422d-aa61-0708f94eff0b tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:37.212009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-5605123d-c431-422d-aa61-0708f94eff0b tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:37.218773 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5605123d-c431-422d-aa61-0708f94eff0b tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:37.219178 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5605123d-c431-422d-aa61-0708f94eff0b tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:37.219832 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5605123d-c431-422d-aa61-0708f94eff0b tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:37.220545 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5605123d-c431-422d-aa61-0708f94eff0b tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:37.221004 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5605123d-c431-422d-aa61-0708f94eff0b tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:37.221436 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5605123d-c431-422d-aa61-0708f94eff0b tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:37.248487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-5605123d-c431-422d-aa61-0708f94eff0b tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Going to try to terminate instance {{(pid=120877) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 21:15:37.295994 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:37.332574 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-e57d5b22-1c39-4967-8bb7-e07427ff84d5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:37.339374 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-e57d5b22-1c39-4967-8bb7-e07427ff84d5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] [instance: e363b06b-e5dd-48c8-a0d8-afdfa5bad759] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:37.344388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-5605123d-c431-422d-aa61-0708f94eff0b tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 204 len: 0 microversion: 2.1 time: 0.136259 Aug 19 21:15:37.345145 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 406/742] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:15:37 2022] DELETE /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 21:15:37.345951 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e57d5b22-1c39-4967-8bb7-e07427ff84d5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:37.346545 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e57d5b22-1c39-4967-8bb7-e07427ff84d5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:37.346982 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e57d5b22-1c39-4967-8bb7-e07427ff84d5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:37.347792 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e57d5b22-1c39-4967-8bb7-e07427ff84d5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:37.348326 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e57d5b22-1c39-4967-8bb7-e07427ff84d5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:37.349104 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e57d5b22-1c39-4967-8bb7-e07427ff84d5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:37.355152 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-f1055743-fb37-419b-83d3-ebfec1741d38 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:37.355934 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-f1055743-fb37-419b-83d3-ebfec1741d38 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:37.362300 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f1055743-fb37-419b-83d3-ebfec1741d38 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:37.362797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f1055743-fb37-419b-83d3-ebfec1741d38 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:37.363238 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f1055743-fb37-419b-83d3-ebfec1741d38 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:37.363943 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f1055743-fb37-419b-83d3-ebfec1741d38 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:37.364566 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f1055743-fb37-419b-83d3-ebfec1741d38 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:37.364853 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-e57d5b22-1c39-4967-8bb7-e07427ff84d5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] HTTP exception thrown: Instance e363b06b-e5dd-48c8-a0d8-afdfa5bad759 could not be found. Aug 19 21:15:37.364998 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f1055743-fb37-419b-83d3-ebfec1741d38 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:37.366916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-e57d5b22-1c39-4967-8bb7-e07427ff84d5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Request method failure captured: Aug 19 21:15:37.366916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 HTTP/1.1 Aug 19 21:15:37.366916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:15:37.366916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:15:37.366916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:15:37.366916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:15:37.366916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:15:37.366916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:15:37.366916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:15:37.366916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:15:37.366916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__u_fqu6__XAfEE8we4aMURTivVATLB4jAgDmOFji8LAe6kA4gLjm1nrouNEf5jjDjNj26q2gqZM2Is0Dwmcg8wVlRCJeDOlaq0WksfDdNjKfw7dq4UB7lXlKAtdfsuLSIAySQq0SR_EwssRHXqVK43vCJaIMBR00xJyCTcakpc4R8U Aug 19 21:15:37.366916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:15:37.366916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:15:37.366916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:15:37.366916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:15:37.366916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:15:37.366916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:15:37.366916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: 1c4004ba973b4454865b889d6d1e049a Aug 19 21:15:37.366916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1218485444 Aug 19 21:15:37.366916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:15:37.366916 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:15:37.368266 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1c4004ba973b4454865b889d6d1e049a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c4004ba973b4454865b889d6d1e049a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1c4004ba973b4454865b889d6d1e049a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c4004ba973b4454865b889d6d1e049a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:15:37.368266 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1218485444 Aug 19 21:15:37.368266 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: 1c4004ba973b4454865b889d6d1e049a Aug 19 21:15:37.368266 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1218485444 Aug 19 21:15:37.368266 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-ServerRescueNegativeTestJSON-1218485444-project Aug 19 21:15:37.368266 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:15:37.368266 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:15:37.368266 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: e8e345dbc2114b718c98c70844352c63 Aug 19 21:15:37.368266 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1218485444-project Aug 19 21:15:37.368266 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: > Aug 19 21:15:37.368266 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Instance e363b06b-e5dd-48c8-a0d8-afdfa5bad759 could not be found. Aug 19 21:15:37.368266 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': 'e363b06b-e5dd-48c8-a0d8-afdfa5bad759'} Aug 19 21:15:37.369002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:15:37.369002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:15:37.369002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:15:37.369002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:15:37.369002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:15:37.369002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:15:37.369002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:15:37.369002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:15:37.369002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:15:37.369002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:15:37.369002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e363b06b-e5dd-48c8-a0d8-afdfa5bad759 could not be found. Aug 19 21:15:37.369002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:37.369002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:15:37.369002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:37.369002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:15:37.369002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:15:37.369002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:15:37.369002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:15:37.369002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:15:37.369002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:15:37.371411 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:15:37.371411 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:15:37.371411 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:15:37.371411 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:15:37.371411 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:15:37.371411 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:15:37.371411 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:15:37.371411 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e363b06b-e5dd-48c8-a0d8-afdfa5bad759 could not be found. Aug 19 21:15:37.371411 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:37.371411 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:15:37.371411 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:37.371411 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:15:37.371411 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:15:37.371411 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:15:37.371411 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:15:37.371411 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:15:37.371411 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e363b06b-e5dd-48c8-a0d8-afdfa5bad759 could not be found. Aug 19 21:15:37.371411 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:37.375994 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-e57d5b22-1c39-4967-8bb7-e07427ff84d5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] Returning 404 to user: Instance e363b06b-e5dd-48c8-a0d8-afdfa5bad759 could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:15:37.375994 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-e57d5b22-1c39-4967-8bb7-e07427ff84d5 tempest-ServerRescueNegativeTestJSON-1218485444 tempest-ServerRescueNegativeTestJSON-1218485444-project] 10.222.0.16 "GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759" status: 404 len: 111 microversion: 2.1 time: 0.039777 Aug 19 21:15:37.375994 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 337/743] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:37 2022] GET /compute/v2.1/servers/e363b06b-e5dd-48c8-a0d8-afdfa5bad759 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 19 21:15:37.515835 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-f1055743-fb37-419b-83d3-ebfec1741d38 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:37.526225 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-f1055743-fb37-419b-83d3-ebfec1741d38 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1674 microversion: 2.1 time: 0.175931 Aug 19 21:15:37.527215 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 407/744] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:37 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1674 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:38.561879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-224c5543-108f-48c6-a187-057621d6aed8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:38.563643 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-224c5543-108f-48c6-a187-057621d6aed8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:38.575557 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-224c5543-108f-48c6-a187-057621d6aed8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:38.575884 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-224c5543-108f-48c6-a187-057621d6aed8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:38.576319 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-224c5543-108f-48c6-a187-057621d6aed8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:38.577095 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-224c5543-108f-48c6-a187-057621d6aed8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:38.577606 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-224c5543-108f-48c6-a187-057621d6aed8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:38.578062 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-224c5543-108f-48c6-a187-057621d6aed8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:38.597417 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:39.173523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-224c5543-108f-48c6-a187-057621d6aed8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:39.187267 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-224c5543-108f-48c6-a187-057621d6aed8 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1674 microversion: 2.1 time: 0.641016 Aug 19 21:15:39.190212 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 338/745] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:38 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1674 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:40.214303 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-62c2f8d4-75bc-4352-a1d9-c96d8976ca8f tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:40.215717 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-62c2f8d4-75bc-4352-a1d9-c96d8976ca8f tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:40.223430 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-62c2f8d4-75bc-4352-a1d9-c96d8976ca8f tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:40.224201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-62c2f8d4-75bc-4352-a1d9-c96d8976ca8f tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:40.224861 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-62c2f8d4-75bc-4352-a1d9-c96d8976ca8f tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:40.226030 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-62c2f8d4-75bc-4352-a1d9-c96d8976ca8f tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:40.226604 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-62c2f8d4-75bc-4352-a1d9-c96d8976ca8f tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:40.227068 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-62c2f8d4-75bc-4352-a1d9-c96d8976ca8f tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:40.442316 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-62c2f8d4-75bc-4352-a1d9-c96d8976ca8f tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:40.455391 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-62c2f8d4-75bc-4352-a1d9-c96d8976ca8f tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1607 microversion: 2.1 time: 0.246626 Aug 19 21:15:40.459702 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 408/746] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:40 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1607 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:40.928319 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-967d1eca-93f3-41e6-baaf-017b3cc87988 req-1aa5f994-d016-4e75-ae7e-46fc439665fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e25852-2606-4138-b039-56a9ed0b7f1e", "name": "network-vif-deleted", "tag": "e5fb615f-643a-4ed9-ae40-bd62d59a8fc5"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:15:40.970382 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-967d1eca-93f3-41e6-baaf-017b3cc87988 req-1aa5f994-d016-4e75-ae7e-46fc439665fb service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:40.971202 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-967d1eca-93f3-41e6-baaf-017b3cc87988 req-1aa5f994-d016-4e75-ae7e-46fc439665fb service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:40.971915 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-967d1eca-93f3-41e6-baaf-017b3cc87988 req-1aa5f994-d016-4e75-ae7e-46fc439665fb service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:41.008547 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-967d1eca-93f3-41e6-baaf-017b3cc87988 req-1aa5f994-d016-4e75-ae7e-46fc439665fb service nova] Creating event network-vif-deleted:e5fb615f-643a-4ed9-ae40-bd62d59a8fc5 for instance d7e25852-2606-4138-b039-56a9ed0b7f1e on hv-cinder-85220 Aug 19 21:15:41.015024 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-967d1eca-93f3-41e6-baaf-017b3cc87988 req-1aa5f994-d016-4e75-ae7e-46fc439665fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091115 Aug 19 21:15:41.019067 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 339/747] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:15:41.502989 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ce5b10c8-e19f-479e-9c32-80a9f08b6b8a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:41.505401 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ce5b10c8-e19f-479e-9c32-80a9f08b6b8a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:41.522628 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce5b10c8-e19f-479e-9c32-80a9f08b6b8a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:41.524168 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce5b10c8-e19f-479e-9c32-80a9f08b6b8a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:41.525520 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce5b10c8-e19f-479e-9c32-80a9f08b6b8a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:41.527102 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce5b10c8-e19f-479e-9c32-80a9f08b6b8a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:41.528587 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce5b10c8-e19f-479e-9c32-80a9f08b6b8a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:41.529591 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce5b10c8-e19f-479e-9c32-80a9f08b6b8a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:41.692197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce5b10c8-e19f-479e-9c32-80a9f08b6b8a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:41.696626 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce5b10c8-e19f-479e-9c32-80a9f08b6b8a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:41.698821 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ce5b10c8-e19f-479e-9c32-80a9f08b6b8a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:41.703592 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.objects.instance [None req-ce5b10c8-e19f-479e-9c32-80a9f08b6b8a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lazy-loading 'fault' on Instance uuid d7e25852-2606-4138-b039-56a9ed0b7f1e {{(pid=120877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:15:41.846783 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ce5b10c8-e19f-479e-9c32-80a9f08b6b8a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:41.871508 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ce5b10c8-e19f-479e-9c32-80a9f08b6b8a tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 200 len: 1328 microversion: 2.1 time: 0.392486 Aug 19 21:15:41.872540 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 409/748] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:41 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 1328 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:42.893504 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-b7d116bd-72c4-47ee-8502-ca5102cab5dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:42.895111 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-b7d116bd-72c4-47ee-8502-ca5102cab5dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:42.908232 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b7d116bd-72c4-47ee-8502-ca5102cab5dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:42.909117 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b7d116bd-72c4-47ee-8502-ca5102cab5dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:42.909888 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b7d116bd-72c4-47ee-8502-ca5102cab5dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:42.910896 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b7d116bd-72c4-47ee-8502-ca5102cab5dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:42.914223 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b7d116bd-72c4-47ee-8502-ca5102cab5dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:42.914939 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b7d116bd-72c4-47ee-8502-ca5102cab5dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:42.963266 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-b7d116bd-72c4-47ee-8502-ca5102cab5dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] HTTP exception thrown: Instance d7e25852-2606-4138-b039-56a9ed0b7f1e could not be found. Aug 19 21:15:42.967588 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-b7d116bd-72c4-47ee-8502-ca5102cab5dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Request method failure captured: Aug 19 21:15:42.967588 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e HTTP/1.1 Aug 19 21:15:42.967588 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:15:42.967588 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:15:42.967588 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:15:42.967588 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:15:42.967588 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:15:42.967588 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:15:42.967588 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:15:42.967588 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:15:42.967588 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__vd26Cb0mXv7t9M5WFOOYHhu6_1HXA35W3ospma2g9U7sFDdcDTQIBuuoLDY5brtQJDBOpSgsAo54GXcjus4z5BsvW7cJ7smrx8rnFYGq_2bFs80-KKshEc83AxCejow5QNEXpsTZyIuhP6mkHnlceVP0v4B7UulMMVywTQ5WGeB4E Aug 19 21:15:42.967588 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:15:42.967588 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:15:42.967588 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:15:42.967588 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:15:42.967588 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:15:42.967588 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:15:42.967588 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: def1895e8f3b40f1b608240c60a0066a Aug 19 21:15:42.967588 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-AttachVolumeTestJSON-66626407 Aug 19 21:15:42.967588 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:15:42.967588 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:15:42.970590 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/def1895e8f3b40f1b608240c60a0066a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/def1895e8f3b40f1b608240c60a0066a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_def1895e8f3b40f1b608240c60a0066a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/def1895e8f3b40f1b608240c60a0066a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:15:42.970590 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-AttachVolumeTestJSON-66626407 Aug 19 21:15:42.970590 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: def1895e8f3b40f1b608240c60a0066a Aug 19 21:15:42.970590 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-AttachVolumeTestJSON-66626407 Aug 19 21:15:42.970590 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-AttachVolumeTestJSON-66626407-project Aug 19 21:15:42.970590 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:15:42.970590 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:15:42.970590 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: 8810b3e211d448cea9a506d9183dc13d Aug 19 21:15:42.970590 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-AttachVolumeTestJSON-66626407-project Aug 19 21:15:42.970590 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: > Aug 19 21:15:42.970590 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Instance d7e25852-2606-4138-b039-56a9ed0b7f1e could not be found. Aug 19 21:15:42.970590 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': 'd7e25852-2606-4138-b039-56a9ed0b7f1e'} Aug 19 21:15:42.972209 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:15:42.972209 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:15:42.972209 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:15:42.972209 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:15:42.972209 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:15:42.972209 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:15:42.972209 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:15:42.972209 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:15:42.972209 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:15:42.972209 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:15:42.972209 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e25852-2606-4138-b039-56a9ed0b7f1e could not be found. Aug 19 21:15:42.972209 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:42.972209 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:15:42.972209 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:42.972209 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:15:42.972209 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:15:42.972209 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:15:42.972209 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:15:42.972209 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:15:42.972209 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:15:42.975269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:15:42.975269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:15:42.975269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:15:42.975269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:15:42.975269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:15:42.975269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:15:42.975269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:15:42.975269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e25852-2606-4138-b039-56a9ed0b7f1e could not be found. Aug 19 21:15:42.975269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:42.975269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:15:42.975269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:42.975269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:15:42.975269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:15:42.975269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:15:42.975269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:15:42.975269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:15:42.975269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e25852-2606-4138-b039-56a9ed0b7f1e could not be found. Aug 19 21:15:42.975269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:15:42.979244 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-b7d116bd-72c4-47ee-8502-ca5102cab5dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Returning 404 to user: Instance d7e25852-2606-4138-b039-56a9ed0b7f1e could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:15:42.980945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-b7d116bd-72c4-47ee-8502-ca5102cab5dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 404 len: 111 microversion: 2.1 time: 0.091449 Aug 19 21:15:42.982672 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 340/749] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:42 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 19 21:15:42.992149 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3b0eb56a-bb39-40c2-abef-ac6b3fff8ce9 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '.version_select at 0x7f740bce38b0>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:43.029601 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-3b0eb56a-bb39-40c2-abef-ac6b3fff8ce9 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1681620401" status: 202 len: 0 microversion: 2.1 time: 0.042152 Aug 19 21:15:43.030594 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 410/750] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Aug 19 21:15:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1681620401 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:15:44.149655 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-ee709c94-2fe2-473c-9f85-2c8960c750ca tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Action: 'create', calling method: .version_select at 0x7f740bd6e9d0>, body: {"keypair": {"name": "tempest-keypair-2112281432", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABeWApbVKfJTGbspSOWA73jGSoW8b+yyfdv7u6PyIfYFDknjRyja80hixW2Qe7QnFAURVOU6UCIxyPXQAYvJtDt1lzj6dXaPklPT+p7Dcaz39SE1twQkrLiHNFjWap2OA=="}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:15:44.181864 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-ee709c94-2fe2-473c-9f85-2c8960c750ca tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Getting quotas for project def1895e8f3b40f1b608240c60a0066a. Resources: {'key_pairs'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:15:44.186692 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-ee709c94-2fe2-473c-9f85-2c8960c750ca tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Getting quotas for user 8810b3e211d448cea9a506d9183dc13d and project def1895e8f3b40f1b608240c60a0066a. Resources: {'key_pairs'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:15:44.221119 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-ee709c94-2fe2-473c-9f85-2c8960c750ca tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.075688 Aug 19 21:15:44.222683 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 341/751] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Aug 19 21:15:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:15:46.449003 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ebd0f4b2-9767-4749-a5db-8e4c533623ac tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-99438028", "imageRef": "d1f034cf-f103-477b-bbb5-3298c678db05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb2d1e82-7c52-4d84-986e-754913029373"}], "security_groups": [{"name": "tempest-securitygroup--1260701834"}], "key_name": "tempest-keypair-2112281432", "user_data": "}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:15:46.475804 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=4,nova_api:DELETE=3 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:46.752251 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.network.neutron [None req-ebd0f4b2-9767-4749-a5db-8e4c533623ac tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] validate_networks() for [('cb2d1e82-7c52-4d84-986e-754913029373', None, None, None, None, None)] {{(pid=120877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 21:15:47.422873 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-ebd0f4b2-9767-4749-a5db-8e4c533623ac tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Flavor limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 21:15:47.423583 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-ebd0f4b2-9767-4749-a5db-8e4c533623ac tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Image limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 21:15:47.424683 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-ebd0f4b2-9767-4749-a5db-8e4c533623ac tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Flavor pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 21:15:47.425649 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-ebd0f4b2-9767-4749-a5db-8e4c533623ac tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Image pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 21:15:47.426555 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-ebd0f4b2-9767-4749-a5db-8e4c533623ac tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 21:15:47.470822 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ebd0f4b2-9767-4749-a5db-8e4c533623ac tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:47.472758 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ebd0f4b2-9767-4749-a5db-8e4c533623ac tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:47.473698 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ebd0f4b2-9767-4749-a5db-8e4c533623ac tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:47.475950 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ebd0f4b2-9767-4749-a5db-8e4c533623ac tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:47.476948 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ebd0f4b2-9767-4749-a5db-8e4c533623ac tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:47.478142 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ebd0f4b2-9767-4749-a5db-8e4c533623ac tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:47.519449 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-ebd0f4b2-9767-4749-a5db-8e4c533623ac tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Getting quotas for project def1895e8f3b40f1b608240c60a0066a. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:15:47.525527 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-ebd0f4b2-9767-4749-a5db-8e4c533623ac tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Getting quotas for user 8810b3e211d448cea9a506d9183dc13d and project def1895e8f3b40f1b608240c60a0066a. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:15:47.539578 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ebd0f4b2-9767-4749-a5db-8e4c533623ac tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Going to run 1 instances... {{(pid=120877) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 21:15:47.542977 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ebd0f4b2-9767-4749-a5db-8e4c533623ac tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f034cf-f103-477b-bbb5-3298c678db05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 21:15:47.648967 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ebd0f4b2-9767-4749-a5db-8e4c533623ac tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.208915 Aug 19 21:15:47.650124 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 411/752] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Aug 19 21:15:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 1211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 21:15:47.661197 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d1fcccf0-f4de-4a4d-9b1a-13c4a93f66ae tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:47.661879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-d1fcccf0-f4de-4a4d-9b1a-13c4a93f66ae tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:47.777104 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-d1fcccf0-f4de-4a4d-9b1a-13c4a93f66ae tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:47.788607 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-d1fcccf0-f4de-4a4d-9b1a-13c4a93f66ae tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa" status: 200 len: 1236 microversion: 2.1 time: 0.131399 Aug 19 21:15:47.789999 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 342/753] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:47 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa => generated 1236 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:48.812301 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-78741a19-5b83-4de0-8af4-0396ce0e30c2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:48.815920 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-78741a19-5b83-4de0-8af4-0396ce0e30c2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:48.837066 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-78741a19-5b83-4de0-8af4-0396ce0e30c2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:48.840272 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-78741a19-5b83-4de0-8af4-0396ce0e30c2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:48.840914 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-78741a19-5b83-4de0-8af4-0396ce0e30c2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:48.841825 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-78741a19-5b83-4de0-8af4-0396ce0e30c2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:48.844460 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-78741a19-5b83-4de0-8af4-0396ce0e30c2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:48.845121 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-78741a19-5b83-4de0-8af4-0396ce0e30c2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:48.990116 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-78741a19-5b83-4de0-8af4-0396ce0e30c2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:49.003970 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-78741a19-5b83-4de0-8af4-0396ce0e30c2 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa" status: 200 len: 1288 microversion: 2.1 time: 0.196792 Aug 19 21:15:49.004766 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 412/754] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:48 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa => generated 1288 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:50.029567 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-22b4c94d-b7bc-4cae-b002-599a36ab7b9d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:50.030156 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-22b4c94d-b7bc-4cae-b002-599a36ab7b9d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:50.043950 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-22b4c94d-b7bc-4cae-b002-599a36ab7b9d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:50.045202 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-22b4c94d-b7bc-4cae-b002-599a36ab7b9d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:50.047075 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-22b4c94d-b7bc-4cae-b002-599a36ab7b9d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:50.048853 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-22b4c94d-b7bc-4cae-b002-599a36ab7b9d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:50.049793 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-22b4c94d-b7bc-4cae-b002-599a36ab7b9d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:50.050654 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-22b4c94d-b7bc-4cae-b002-599a36ab7b9d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:50.167637 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-22b4c94d-b7bc-4cae-b002-599a36ab7b9d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:50.198433 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-22b4c94d-b7bc-4cae-b002-599a36ab7b9d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa" status: 200 len: 1294 microversion: 2.1 time: 0.171476 Aug 19 21:15:50.200093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 343/755] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:50 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa => generated 1294 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:51.222213 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8c026977-3fce-483c-8ba5-1e493921cd7d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:51.223463 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8c026977-3fce-483c-8ba5-1e493921cd7d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:51.238829 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c026977-3fce-483c-8ba5-1e493921cd7d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:51.239331 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c026977-3fce-483c-8ba5-1e493921cd7d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:51.239778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c026977-3fce-483c-8ba5-1e493921cd7d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:51.240597 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c026977-3fce-483c-8ba5-1e493921cd7d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:51.241063 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c026977-3fce-483c-8ba5-1e493921cd7d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:51.241494 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c026977-3fce-483c-8ba5-1e493921cd7d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:51.540943 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8c026977-3fce-483c-8ba5-1e493921cd7d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:51.554045 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8c026977-3fce-483c-8ba5-1e493921cd7d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa" status: 200 len: 1362 microversion: 2.1 time: 0.335523 Aug 19 21:15:51.554989 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 413/756] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:51 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa => generated 1362 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:52.051079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-f9ed4c69-1ce8-4df5-ad72-f328aaa5e496 req-73fd453e-d256-4e1e-9b10-e6fd19a8f8ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8999d988-6f08-4866-9aeb-61070698d7aa", "tag": "2c8e7c10-6166-4c38-8790-ffeaa8c7b236"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:15:52.081311 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-f9ed4c69-1ce8-4df5-ad72-f328aaa5e496 req-73fd453e-d256-4e1e-9b10-e6fd19a8f8ab service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:52.083519 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-f9ed4c69-1ce8-4df5-ad72-f328aaa5e496 req-73fd453e-d256-4e1e-9b10-e6fd19a8f8ab service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:52.084656 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-f9ed4c69-1ce8-4df5-ad72-f328aaa5e496 req-73fd453e-d256-4e1e-9b10-e6fd19a8f8ab service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:52.108530 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-f9ed4c69-1ce8-4df5-ad72-f328aaa5e496 req-73fd453e-d256-4e1e-9b10-e6fd19a8f8ab service nova] Creating event network-changed:2c8e7c10-6166-4c38-8790-ffeaa8c7b236 for instance 8999d988-6f08-4866-9aeb-61070698d7aa on hv-cinder-85220 Aug 19 21:15:52.115869 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-f9ed4c69-1ce8-4df5-ad72-f328aaa5e496 req-73fd453e-d256-4e1e-9b10-e6fd19a8f8ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068617 Aug 19 21:15:52.119386 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 344/757] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:15:52.591784 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-daa5947e-6126-4e99-9b7b-453a1f86e7d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:52.593164 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-daa5947e-6126-4e99-9b7b-453a1f86e7d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:52.603583 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-daa5947e-6126-4e99-9b7b-453a1f86e7d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:52.604432 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-daa5947e-6126-4e99-9b7b-453a1f86e7d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:52.605096 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-daa5947e-6126-4e99-9b7b-453a1f86e7d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:52.606746 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-daa5947e-6126-4e99-9b7b-453a1f86e7d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:52.608201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-daa5947e-6126-4e99-9b7b-453a1f86e7d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:52.608805 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-daa5947e-6126-4e99-9b7b-453a1f86e7d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:52.922605 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-daa5947e-6126-4e99-9b7b-453a1f86e7d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:52.933106 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-daa5947e-6126-4e99-9b7b-453a1f86e7d5 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa" status: 200 len: 1362 microversion: 2.1 time: 0.355211 Aug 19 21:15:52.949194 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 414/758] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:52 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa => generated 1362 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:53.957405 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-99f817f7-67ac-400e-8790-b653e4b2b7c0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:53.961147 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-99f817f7-67ac-400e-8790-b653e4b2b7c0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:53.986437 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-99f817f7-67ac-400e-8790-b653e4b2b7c0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:53.987599 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-99f817f7-67ac-400e-8790-b653e4b2b7c0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:53.989063 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-99f817f7-67ac-400e-8790-b653e4b2b7c0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:53.991374 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-99f817f7-67ac-400e-8790-b653e4b2b7c0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:53.993419 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-99f817f7-67ac-400e-8790-b653e4b2b7c0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:53.994311 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-99f817f7-67ac-400e-8790-b653e4b2b7c0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:54.204076 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-99f817f7-67ac-400e-8790-b653e4b2b7c0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:54.212924 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-99f817f7-67ac-400e-8790-b653e4b2b7c0 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa" status: 200 len: 1362 microversion: 2.1 time: 0.260391 Aug 19 21:15:54.217283 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-c52dc87a-2b05-46db-88ed-f6e3389672ed tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Action: 'create', calling method: .version_select at 0x7f740bbe9550>, body: {"keypair": {"name": "tempest-TestShelveInstance-960460966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2XiEfrY73z+dS38N2FIjJKR6hPjFJc5mA3WZxGseo43bWlMq79F0WdZDJGeZSWUzDwqgpTDVPEWepXY2M1fG8WaVJoC/6HxXElLz6aEIkVMlbod+49fntCbNVGY7LkoA=="}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:15:54.222309 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 415/759] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:53 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:54.235992 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-c52dc87a-2b05-46db-88ed-f6e3389672ed tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Getting quotas for project b8d769840e964ef5923aa9c28265be03. Resources: {'key_pairs'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:15:54.241386 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-c52dc87a-2b05-46db-88ed-f6e3389672ed tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Getting quotas for user f7ed8b3dc88c4fadbb0839fd848397d1 and project b8d769840e964ef5923aa9c28265be03. Resources: {'key_pairs'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:15:54.268325 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-c52dc87a-2b05-46db-88ed-f6e3389672ed tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.347137 Aug 19 21:15:54.269416 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 345/760] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Aug 19 21:15:53 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:15:55.235244 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-fe4c5f79-e315-4a32-bfe7-4787dd3a8f73 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:55.236063 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-fe4c5f79-e315-4a32-bfe7-4787dd3a8f73 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:55.244492 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fe4c5f79-e315-4a32-bfe7-4787dd3a8f73 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:55.244983 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fe4c5f79-e315-4a32-bfe7-4787dd3a8f73 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:55.245618 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fe4c5f79-e315-4a32-bfe7-4787dd3a8f73 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:55.246404 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fe4c5f79-e315-4a32-bfe7-4787dd3a8f73 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:55.246862 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fe4c5f79-e315-4a32-bfe7-4787dd3a8f73 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:55.247283 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fe4c5f79-e315-4a32-bfe7-4787dd3a8f73 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:55.476189 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-fe4c5f79-e315-4a32-bfe7-4787dd3a8f73 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:55.484739 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-fe4c5f79-e315-4a32-bfe7-4787dd3a8f73 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa" status: 200 len: 1362 microversion: 2.1 time: 0.253493 Aug 19 21:15:55.486116 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 416/761] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:55 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:56.509789 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-8b7a4d50-a30e-47a7-8528-fb94d0557670 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:56.510291 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-8b7a4d50-a30e-47a7-8528-fb94d0557670 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:56.525437 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:56.534560 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8b7a4d50-a30e-47a7-8528-fb94d0557670 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:56.535073 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8b7a4d50-a30e-47a7-8528-fb94d0557670 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:56.535572 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8b7a4d50-a30e-47a7-8528-fb94d0557670 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:56.536305 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8b7a4d50-a30e-47a7-8528-fb94d0557670 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:56.536955 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8b7a4d50-a30e-47a7-8528-fb94d0557670 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:56.537562 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8b7a4d50-a30e-47a7-8528-fb94d0557670 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:56.739157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-8b7a4d50-a30e-47a7-8528-fb94d0557670 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:56.749737 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-8b7a4d50-a30e-47a7-8528-fb94d0557670 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa" status: 200 len: 1362 microversion: 2.1 time: 0.244354 Aug 19 21:15:56.749737 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 346/762] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:56 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:57.792390 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-546a293d-518a-45dc-83e5-9ab73fe9b7aa tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:57.794685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-546a293d-518a-45dc-83e5-9ab73fe9b7aa tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:57.807524 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=2 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:57.809092 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=6 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:15:57.811401 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-546a293d-518a-45dc-83e5-9ab73fe9b7aa tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:57.812624 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-546a293d-518a-45dc-83e5-9ab73fe9b7aa tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:57.813323 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-546a293d-518a-45dc-83e5-9ab73fe9b7aa tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:57.814572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-546a293d-518a-45dc-83e5-9ab73fe9b7aa tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:57.815972 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-546a293d-518a-45dc-83e5-9ab73fe9b7aa tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:57.817544 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-546a293d-518a-45dc-83e5-9ab73fe9b7aa tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:58.073287 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-546a293d-518a-45dc-83e5-9ab73fe9b7aa tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:58.090425 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-546a293d-518a-45dc-83e5-9ab73fe9b7aa tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa" status: 200 len: 1362 microversion: 2.1 time: 0.310413 Aug 19 21:15:58.106482 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 417/763] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:57 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa => generated 1362 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:15:58.312265 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-b2e79914-f552-496a-b13d-f6a3df5e35e7 req-7b798919-8149-4c2c-b16f-b4999e726b89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8999d988-6f08-4866-9aeb-61070698d7aa", "name": "network-vif-plugged", "status": "completed", "tag": "2c8e7c10-6166-4c38-8790-ffeaa8c7b236"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:15:58.327425 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-b2e79914-f552-496a-b13d-f6a3df5e35e7 req-7b798919-8149-4c2c-b16f-b4999e726b89 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:58.328203 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-b2e79914-f552-496a-b13d-f6a3df5e35e7 req-7b798919-8149-4c2c-b16f-b4999e726b89 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:58.328847 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-b2e79914-f552-496a-b13d-f6a3df5e35e7 req-7b798919-8149-4c2c-b16f-b4999e726b89 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:58.344373 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-b2e79914-f552-496a-b13d-f6a3df5e35e7 req-7b798919-8149-4c2c-b16f-b4999e726b89 service nova] Creating event network-vif-plugged:2c8e7c10-6166-4c38-8790-ffeaa8c7b236 for instance 8999d988-6f08-4866-9aeb-61070698d7aa on hv-cinder-85220 Aug 19 21:15:58.351073 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-b2e79914-f552-496a-b13d-f6a3df5e35e7 req-7b798919-8149-4c2c-b16f-b4999e726b89 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042491 Aug 19 21:15:58.352524 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 347/764] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:15:59.115624 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e4f20361-4c5d-48e6-9aa1-a66f48580a13 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:15:59.116367 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-e4f20361-4c5d-48e6-9aa1-a66f48580a13 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:15:59.123779 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e4f20361-4c5d-48e6-9aa1-a66f48580a13 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:59.124293 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e4f20361-4c5d-48e6-9aa1-a66f48580a13 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:59.124732 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e4f20361-4c5d-48e6-9aa1-a66f48580a13 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:59.125678 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e4f20361-4c5d-48e6-9aa1-a66f48580a13 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:15:59.126543 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e4f20361-4c5d-48e6-9aa1-a66f48580a13 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:15:59.127041 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e4f20361-4c5d-48e6-9aa1-a66f48580a13 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:15:59.324681 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e4f20361-4c5d-48e6-9aa1-a66f48580a13 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:15:59.333068 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e4f20361-4c5d-48e6-9aa1-a66f48580a13 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa" status: 200 len: 1362 microversion: 2.1 time: 0.221964 Aug 19 21:15:59.334215 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 418/765] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:15:59 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:16:00.357919 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-a3ad27d3-0c7f-48c9-8c66-2ba7356844ec tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:00.358543 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-a3ad27d3-0c7f-48c9-8c66-2ba7356844ec tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:00.365958 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a3ad27d3-0c7f-48c9-8c66-2ba7356844ec tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:00.366450 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a3ad27d3-0c7f-48c9-8c66-2ba7356844ec tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:00.366902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a3ad27d3-0c7f-48c9-8c66-2ba7356844ec tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:00.367649 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a3ad27d3-0c7f-48c9-8c66-2ba7356844ec tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:00.368110 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a3ad27d3-0c7f-48c9-8c66-2ba7356844ec tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:00.368534 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a3ad27d3-0c7f-48c9-8c66-2ba7356844ec tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:00.551935 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-a3ad27d3-0c7f-48c9-8c66-2ba7356844ec tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:00.560739 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-a3ad27d3-0c7f-48c9-8c66-2ba7356844ec tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa" status: 200 len: 1548 microversion: 2.1 time: 0.207725 Aug 19 21:16:00.561334 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 348/766] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:00 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa => generated 1548 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:16:00.593984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-147acf7c-2c6f-463e-846d-2024f173bbef tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:00.594789 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-147acf7c-2c6f-463e-846d-2024f173bbef tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:00.603394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-147acf7c-2c6f-463e-846d-2024f173bbef tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:00.603881 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-147acf7c-2c6f-463e-846d-2024f173bbef tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:00.604317 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-147acf7c-2c6f-463e-846d-2024f173bbef tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:00.605023 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-147acf7c-2c6f-463e-846d-2024f173bbef tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:00.607320 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-147acf7c-2c6f-463e-846d-2024f173bbef tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:00.607320 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-147acf7c-2c6f-463e-846d-2024f173bbef tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:00.723479 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-147acf7c-2c6f-463e-846d-2024f173bbef tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.133592 Aug 19 21:16:00.724831 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 419/767] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Aug 19 21:16:00 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:16:01.873821 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-1b9cb61d-c8a8-4bf1-aa22-4ef55eb7a525 req-eda9613f-f88c-4f1d-a06d-ef40bd910ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8999d988-6f08-4866-9aeb-61070698d7aa", "tag": "2c8e7c10-6166-4c38-8790-ffeaa8c7b236"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:16:01.886319 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-1b9cb61d-c8a8-4bf1-aa22-4ef55eb7a525 req-eda9613f-f88c-4f1d-a06d-ef40bd910ce5 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:01.887348 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-1b9cb61d-c8a8-4bf1-aa22-4ef55eb7a525 req-eda9613f-f88c-4f1d-a06d-ef40bd910ce5 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:01.887889 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-1b9cb61d-c8a8-4bf1-aa22-4ef55eb7a525 req-eda9613f-f88c-4f1d-a06d-ef40bd910ce5 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:01.903957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-1b9cb61d-c8a8-4bf1-aa22-4ef55eb7a525 req-eda9613f-f88c-4f1d-a06d-ef40bd910ce5 service nova] Creating event network-changed:2c8e7c10-6166-4c38-8790-ffeaa8c7b236 for instance 8999d988-6f08-4866-9aeb-61070698d7aa on hv-cinder-85220 Aug 19 21:16:01.909080 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-1b9cb61d-c8a8-4bf1-aa22-4ef55eb7a525 req-eda9613f-f88c-4f1d-a06d-ef40bd910ce5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039177 Aug 19 21:16:01.910007 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 349/768] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:16:29.289898 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:29.290821 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=1 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:29.296050 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-9871c2c2-7b38-4c58-9130-09fe7bb48a8e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-528486341", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-960460966", "security_groups": [{"name": "tempest-secgroup-smoke-610784243"}], "networks": [{"uuid": "dfee3a28-a017-42b4-ba5b-8436873403e7"}], "block_device_mapping_v2": [{"uuid": "bc9dac86-bfc6-4b99-97d4-4b84e334658c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:16:29.422061 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.network.neutron [None req-9871c2c2-7b38-4c58-9130-09fe7bb48a8e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] validate_networks() for [('dfee3a28-a017-42b4-ba5b-8436873403e7', None, None, None, None, None)] {{(pid=120877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 21:16:29.834866 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-9871c2c2-7b38-4c58-9130-09fe7bb48a8e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Flavor limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 21:16:29.835285 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-9871c2c2-7b38-4c58-9130-09fe7bb48a8e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Image limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 21:16:29.835760 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-9871c2c2-7b38-4c58-9130-09fe7bb48a8e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Flavor pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 21:16:29.836160 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-9871c2c2-7b38-4c58-9130-09fe7bb48a8e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Image pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 21:16:29.836566 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-9871c2c2-7b38-4c58-9130-09fe7bb48a8e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 21:16:29.846137 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9871c2c2-7b38-4c58-9130-09fe7bb48a8e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:29.846617 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9871c2c2-7b38-4c58-9130-09fe7bb48a8e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:29.847048 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9871c2c2-7b38-4c58-9130-09fe7bb48a8e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:29.847776 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9871c2c2-7b38-4c58-9130-09fe7bb48a8e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:29.848227 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9871c2c2-7b38-4c58-9130-09fe7bb48a8e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:29.848642 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9871c2c2-7b38-4c58-9130-09fe7bb48a8e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:29.868320 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-9871c2c2-7b38-4c58-9130-09fe7bb48a8e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Getting quotas for project b8d769840e964ef5923aa9c28265be03. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:16:29.872098 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-9871c2c2-7b38-4c58-9130-09fe7bb48a8e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Getting quotas for user f7ed8b3dc88c4fadbb0839fd848397d1 and project b8d769840e964ef5923aa9c28265be03. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:16:29.934111 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-9871c2c2-7b38-4c58-9130-09fe7bb48a8e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Going to run 1 instances... {{(pid=120877) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 21:16:29.936156 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-9871c2c2-7b38-4c58-9130-09fe7bb48a8e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bc9dac86-bfc6-4b99-97d4-4b84e334658c',volume_size=None,volume_type=None)] {{(pid=120877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 21:16:30.072622 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-9871c2c2-7b38-4c58-9130-09fe7bb48a8e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.785079 Aug 19 21:16:30.073257 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 420/769] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Aug 19 21:16:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 21:16:30.081807 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=10 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:30.083041 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=7 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:30.084165 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=31 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:30.088992 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-3c8b5e20-5ab8-4664-a0a4-2c092960324e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:30.089700 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-3c8b5e20-5ab8-4664-a0a4-2c092960324e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:30.154696 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-3c8b5e20-5ab8-4664-a0a4-2c092960324e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:30.161756 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-3c8b5e20-5ab8-4664-a0a4-2c092960324e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1087 microversion: 2.1 time: 0.081339 Aug 19 21:16:30.162366 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 350/770] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:30 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1087 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:16:31.183158 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8168338f-794c-43b9-8cbb-89f555f62172 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:31.183767 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8168338f-794c-43b9-8cbb-89f555f62172 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:31.189862 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8168338f-794c-43b9-8cbb-89f555f62172 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:31.190349 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8168338f-794c-43b9-8cbb-89f555f62172 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:31.190782 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8168338f-794c-43b9-8cbb-89f555f62172 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:31.191471 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8168338f-794c-43b9-8cbb-89f555f62172 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:31.191923 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8168338f-794c-43b9-8cbb-89f555f62172 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:31.192346 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8168338f-794c-43b9-8cbb-89f555f62172 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:31.255015 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8168338f-794c-43b9-8cbb-89f555f62172 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:31.262930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8168338f-794c-43b9-8cbb-89f555f62172 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1137 microversion: 2.1 time: 0.083862 Aug 19 21:16:31.263494 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 421/771] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:31 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:16:32.283817 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-ff149416-de49-47b7-ab4a-22824b2a2abb tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:32.284415 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-ff149416-de49-47b7-ab4a-22824b2a2abb tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:32.293942 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ff149416-de49-47b7-ab4a-22824b2a2abb tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:32.294420 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ff149416-de49-47b7-ab4a-22824b2a2abb tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:32.294844 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ff149416-de49-47b7-ab4a-22824b2a2abb tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:32.295531 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ff149416-de49-47b7-ab4a-22824b2a2abb tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:32.295977 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ff149416-de49-47b7-ab4a-22824b2a2abb tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:32.296388 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ff149416-de49-47b7-ab4a-22824b2a2abb tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:32.358243 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-ff149416-de49-47b7-ab4a-22824b2a2abb tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:32.366352 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-ff149416-de49-47b7-ab4a-22824b2a2abb tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1137 microversion: 2.1 time: 0.086334 Aug 19 21:16:32.367597 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 351/772] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:32 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1137 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:16:33.388542 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-eba82ef1-c063-486e-b684-334f54967f17 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:33.389132 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-eba82ef1-c063-486e-b684-334f54967f17 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:33.395553 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eba82ef1-c063-486e-b684-334f54967f17 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:33.396035 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eba82ef1-c063-486e-b684-334f54967f17 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:33.396474 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eba82ef1-c063-486e-b684-334f54967f17 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:33.397161 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eba82ef1-c063-486e-b684-334f54967f17 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:33.397640 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eba82ef1-c063-486e-b684-334f54967f17 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:33.398682 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eba82ef1-c063-486e-b684-334f54967f17 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:33.462382 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-eba82ef1-c063-486e-b684-334f54967f17 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:33.470278 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-eba82ef1-c063-486e-b684-334f54967f17 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1137 microversion: 2.1 time: 0.085974 Aug 19 21:16:33.470842 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 422/773] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:33 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:16:34.492574 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-db3df1fa-da6a-491b-8810-7dfe289b1020 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:34.493145 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-db3df1fa-da6a-491b-8810-7dfe289b1020 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:34.501362 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-db3df1fa-da6a-491b-8810-7dfe289b1020 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:34.501883 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-db3df1fa-da6a-491b-8810-7dfe289b1020 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:34.502330 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-db3df1fa-da6a-491b-8810-7dfe289b1020 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:34.503050 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-db3df1fa-da6a-491b-8810-7dfe289b1020 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:34.503512 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-db3df1fa-da6a-491b-8810-7dfe289b1020 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:34.503940 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-db3df1fa-da6a-491b-8810-7dfe289b1020 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:34.570857 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-db3df1fa-da6a-491b-8810-7dfe289b1020 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:34.580211 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-db3df1fa-da6a-491b-8810-7dfe289b1020 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1185 microversion: 2.1 time: 0.092854 Aug 19 21:16:34.581076 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 352/774] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:34 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:16:35.604501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-830cf5c2-dfbf-4e62-93d3-c113bdb19481 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:35.605240 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-830cf5c2-dfbf-4e62-93d3-c113bdb19481 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:35.615473 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-830cf5c2-dfbf-4e62-93d3-c113bdb19481 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:35.616281 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-830cf5c2-dfbf-4e62-93d3-c113bdb19481 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:35.618224 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-830cf5c2-dfbf-4e62-93d3-c113bdb19481 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:35.620045 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-830cf5c2-dfbf-4e62-93d3-c113bdb19481 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:35.620701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-830cf5c2-dfbf-4e62-93d3-c113bdb19481 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:35.621432 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-830cf5c2-dfbf-4e62-93d3-c113bdb19481 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:35.802491 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-830cf5c2-dfbf-4e62-93d3-c113bdb19481 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:35.811700 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-830cf5c2-dfbf-4e62-93d3-c113bdb19481 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1270 microversion: 2.1 time: 0.211932 Aug 19 21:16:35.812352 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 423/775] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:35 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1270 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:16:36.234710 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-43684686-cfe6-41cd-a2fe-94e63da0eab5 req-bb78e358-8896-4293-9fc4-59b4f15b0497 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84087b72-4e56-413e-b975-c23f9f79d0d0", "tag": "702f349d-7673-4c52-a88b-8c4ef8a04aa4"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:16:36.249656 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-43684686-cfe6-41cd-a2fe-94e63da0eab5 req-bb78e358-8896-4293-9fc4-59b4f15b0497 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:36.250674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-43684686-cfe6-41cd-a2fe-94e63da0eab5 req-bb78e358-8896-4293-9fc4-59b4f15b0497 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:36.251120 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-43684686-cfe6-41cd-a2fe-94e63da0eab5 req-bb78e358-8896-4293-9fc4-59b4f15b0497 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:36.263931 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-43684686-cfe6-41cd-a2fe-94e63da0eab5 req-bb78e358-8896-4293-9fc4-59b4f15b0497 service nova] Creating event network-changed:702f349d-7673-4c52-a88b-8c4ef8a04aa4 for instance 84087b72-4e56-413e-b975-c23f9f79d0d0 on hv-cinder-85220 Aug 19 21:16:36.268947 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-43684686-cfe6-41cd-a2fe-94e63da0eab5 req-bb78e358-8896-4293-9fc4-59b4f15b0497 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038032 Aug 19 21:16:36.269982 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 353/776] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:16:36.834009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-d7fc4c8d-8c91-4ad8-b5e2-45f09fe8cfaf tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:36.834678 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-d7fc4c8d-8c91-4ad8-b5e2-45f09fe8cfaf tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:36.841684 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d7fc4c8d-8c91-4ad8-b5e2-45f09fe8cfaf tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:36.842196 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d7fc4c8d-8c91-4ad8-b5e2-45f09fe8cfaf tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:36.842628 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d7fc4c8d-8c91-4ad8-b5e2-45f09fe8cfaf tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:36.843313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d7fc4c8d-8c91-4ad8-b5e2-45f09fe8cfaf tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:36.843760 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d7fc4c8d-8c91-4ad8-b5e2-45f09fe8cfaf tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:36.844175 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d7fc4c8d-8c91-4ad8-b5e2-45f09fe8cfaf tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:36.995284 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-d7fc4c8d-8c91-4ad8-b5e2-45f09fe8cfaf tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:37.007222 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-d7fc4c8d-8c91-4ad8-b5e2-45f09fe8cfaf tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1258 microversion: 2.1 time: 0.177269 Aug 19 21:16:37.007817 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 424/777] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:36 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:16:38.032738 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-f83159b9-06a9-41d0-ba6a-7ff3e051795c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:38.033491 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-f83159b9-06a9-41d0-ba6a-7ff3e051795c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:38.043343 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f83159b9-06a9-41d0-ba6a-7ff3e051795c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:38.043834 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f83159b9-06a9-41d0-ba6a-7ff3e051795c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:38.044270 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f83159b9-06a9-41d0-ba6a-7ff3e051795c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:38.044973 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f83159b9-06a9-41d0-ba6a-7ff3e051795c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:38.045426 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f83159b9-06a9-41d0-ba6a-7ff3e051795c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:38.045879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f83159b9-06a9-41d0-ba6a-7ff3e051795c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:38.212960 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-f83159b9-06a9-41d0-ba6a-7ff3e051795c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:38.221233 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-f83159b9-06a9-41d0-ba6a-7ff3e051795c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1258 microversion: 2.1 time: 0.193217 Aug 19 21:16:38.221840 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 354/778] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:38 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1258 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:16:39.242335 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-f2211d9d-adbc-4234-9c33-5f7f0330d367 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:39.242957 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-f2211d9d-adbc-4234-9c33-5f7f0330d367 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:39.249577 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f2211d9d-adbc-4234-9c33-5f7f0330d367 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:39.250105 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f2211d9d-adbc-4234-9c33-5f7f0330d367 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:39.250554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f2211d9d-adbc-4234-9c33-5f7f0330d367 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:39.251257 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f2211d9d-adbc-4234-9c33-5f7f0330d367 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:39.251713 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f2211d9d-adbc-4234-9c33-5f7f0330d367 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:39.252138 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f2211d9d-adbc-4234-9c33-5f7f0330d367 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:39.399249 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-f2211d9d-adbc-4234-9c33-5f7f0330d367 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:39.408165 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-f2211d9d-adbc-4234-9c33-5f7f0330d367 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1258 microversion: 2.1 time: 0.170271 Aug 19 21:16:39.408734 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 425/779] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:39 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:16:40.428699 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-743f5060-ba46-42f8-97ca-a5611e95b466 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:40.429502 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-743f5060-ba46-42f8-97ca-a5611e95b466 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:40.432006 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=2 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:40.437309 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-743f5060-ba46-42f8-97ca-a5611e95b466 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:40.437823 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-743f5060-ba46-42f8-97ca-a5611e95b466 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:40.438287 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-743f5060-ba46-42f8-97ca-a5611e95b466 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:40.438966 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-743f5060-ba46-42f8-97ca-a5611e95b466 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:40.439415 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-743f5060-ba46-42f8-97ca-a5611e95b466 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:40.439830 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-743f5060-ba46-42f8-97ca-a5611e95b466 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:40.577878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-743f5060-ba46-42f8-97ca-a5611e95b466 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:40.586475 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-743f5060-ba46-42f8-97ca-a5611e95b466 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1258 microversion: 2.1 time: 0.160942 Aug 19 21:16:40.587028 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 355/780] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:40 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:16:41.607697 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-58bf24dd-fe9a-42c3-a0ec-9a349caed89d tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:41.608303 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-58bf24dd-fe9a-42c3-a0ec-9a349caed89d tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:41.610183 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=2 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:41.610822 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=6 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:41.617700 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58bf24dd-fe9a-42c3-a0ec-9a349caed89d tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:41.618200 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58bf24dd-fe9a-42c3-a0ec-9a349caed89d tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:41.618631 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58bf24dd-fe9a-42c3-a0ec-9a349caed89d tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:41.619314 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58bf24dd-fe9a-42c3-a0ec-9a349caed89d tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:41.619761 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58bf24dd-fe9a-42c3-a0ec-9a349caed89d tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:41.620178 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58bf24dd-fe9a-42c3-a0ec-9a349caed89d tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:41.757968 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-58bf24dd-fe9a-42c3-a0ec-9a349caed89d tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:41.765962 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-58bf24dd-fe9a-42c3-a0ec-9a349caed89d tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1258 microversion: 2.1 time: 0.162201 Aug 19 21:16:41.766531 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 426/781] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:41 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:16:42.796820 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-2611275f-5dbc-43e2-a6d7-1bcea2c5cec7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:42.797431 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-2611275f-5dbc-43e2-a6d7-1bcea2c5cec7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:42.803955 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2611275f-5dbc-43e2-a6d7-1bcea2c5cec7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:42.804433 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2611275f-5dbc-43e2-a6d7-1bcea2c5cec7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:42.804855 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2611275f-5dbc-43e2-a6d7-1bcea2c5cec7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:42.805543 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2611275f-5dbc-43e2-a6d7-1bcea2c5cec7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:42.806020 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2611275f-5dbc-43e2-a6d7-1bcea2c5cec7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:42.807138 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2611275f-5dbc-43e2-a6d7-1bcea2c5cec7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:42.975385 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-2611275f-5dbc-43e2-a6d7-1bcea2c5cec7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:42.985202 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-2611275f-5dbc-43e2-a6d7-1bcea2c5cec7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1258 microversion: 2.1 time: 0.201209 Aug 19 21:16:42.985804 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 356/782] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:42 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1258 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:16:44.007765 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-cfe18adb-9ad3-4d00-8b9c-bd0dc0565f95 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:44.009013 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-cfe18adb-9ad3-4d00-8b9c-bd0dc0565f95 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:44.017637 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cfe18adb-9ad3-4d00-8b9c-bd0dc0565f95 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:44.018236 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cfe18adb-9ad3-4d00-8b9c-bd0dc0565f95 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:44.018741 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cfe18adb-9ad3-4d00-8b9c-bd0dc0565f95 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:44.019448 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cfe18adb-9ad3-4d00-8b9c-bd0dc0565f95 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:44.019903 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cfe18adb-9ad3-4d00-8b9c-bd0dc0565f95 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:44.020321 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cfe18adb-9ad3-4d00-8b9c-bd0dc0565f95 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:44.175733 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-cfe18adb-9ad3-4d00-8b9c-bd0dc0565f95 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:44.184716 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-cfe18adb-9ad3-4d00-8b9c-bd0dc0565f95 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1258 microversion: 2.1 time: 0.181592 Aug 19 21:16:44.185302 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 427/783] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:44 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1258 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:16:44.258190 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-22e7cb2d-589b-4e22-a5c3-94716b9c60fa tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:44.258765 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-22e7cb2d-589b-4e22-a5c3-94716b9c60fa tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:44.266586 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-22e7cb2d-589b-4e22-a5c3-94716b9c60fa tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:44.267076 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-22e7cb2d-589b-4e22-a5c3-94716b9c60fa tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:44.267506 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-22e7cb2d-589b-4e22-a5c3-94716b9c60fa tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:44.268201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-22e7cb2d-589b-4e22-a5c3-94716b9c60fa tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:44.268652 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-22e7cb2d-589b-4e22-a5c3-94716b9c60fa tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:44.269067 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-22e7cb2d-589b-4e22-a5c3-94716b9c60fa tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:44.295448 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-22e7cb2d-589b-4e22-a5c3-94716b9c60fa tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f/ips" status: 200 len: 150 microversion: 2.1 time: 0.041062 Aug 19 21:16:44.296024 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 357/784] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Aug 19 21:16:44 2022] GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:16:45.208501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-08a879aa-aac2-4cd2-98c7-6ce671cf538b tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:45.209358 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-08a879aa-aac2-4cd2-98c7-6ce671cf538b tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:45.218778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-08a879aa-aac2-4cd2-98c7-6ce671cf538b tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:45.219659 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-08a879aa-aac2-4cd2-98c7-6ce671cf538b tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:45.220459 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-08a879aa-aac2-4cd2-98c7-6ce671cf538b tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:45.221797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-08a879aa-aac2-4cd2-98c7-6ce671cf538b tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:45.222658 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-08a879aa-aac2-4cd2-98c7-6ce671cf538b tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:45.223444 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-08a879aa-aac2-4cd2-98c7-6ce671cf538b tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:45.386135 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-08a879aa-aac2-4cd2-98c7-6ce671cf538b tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:45.394773 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-08a879aa-aac2-4cd2-98c7-6ce671cf538b tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1258 microversion: 2.1 time: 0.191853 Aug 19 21:16:45.395355 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 428/785] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:45 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1258 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:16:46.415207 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-fb2de2dd-07df-4ccc-93a1-999589693f86 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:46.416696 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-fb2de2dd-07df-4ccc-93a1-999589693f86 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:46.422805 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fb2de2dd-07df-4ccc-93a1-999589693f86 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:46.423299 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fb2de2dd-07df-4ccc-93a1-999589693f86 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:46.423737 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fb2de2dd-07df-4ccc-93a1-999589693f86 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:46.424453 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fb2de2dd-07df-4ccc-93a1-999589693f86 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:46.424908 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fb2de2dd-07df-4ccc-93a1-999589693f86 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:46.425330 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fb2de2dd-07df-4ccc-93a1-999589693f86 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:46.574872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-fb2de2dd-07df-4ccc-93a1-999589693f86 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:46.583071 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-fb2de2dd-07df-4ccc-93a1-999589693f86 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1258 microversion: 2.1 time: 0.171766 Aug 19 21:16:46.583657 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 358/786] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:46 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:16:47.606125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e0a31c04-bfca-4004-99a5-7ef2a1c8a1c7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:47.606824 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-e0a31c04-bfca-4004-99a5-7ef2a1c8a1c7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:47.614308 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e0a31c04-bfca-4004-99a5-7ef2a1c8a1c7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:47.614793 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e0a31c04-bfca-4004-99a5-7ef2a1c8a1c7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:47.615224 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e0a31c04-bfca-4004-99a5-7ef2a1c8a1c7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:47.615913 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e0a31c04-bfca-4004-99a5-7ef2a1c8a1c7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:47.616365 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e0a31c04-bfca-4004-99a5-7ef2a1c8a1c7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:47.616783 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e0a31c04-bfca-4004-99a5-7ef2a1c8a1c7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:47.765682 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e0a31c04-bfca-4004-99a5-7ef2a1c8a1c7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:47.773502 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e0a31c04-bfca-4004-99a5-7ef2a1c8a1c7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1258 microversion: 2.1 time: 0.171366 Aug 19 21:16:47.774161 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 429/787] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:47 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:16:48.794372 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-7be1629e-a0d1-4370-ab62-6be55c664dd5 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:48.794966 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-7be1629e-a0d1-4370-ab62-6be55c664dd5 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:48.801933 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7be1629e-a0d1-4370-ab62-6be55c664dd5 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:48.802494 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7be1629e-a0d1-4370-ab62-6be55c664dd5 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:48.802926 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7be1629e-a0d1-4370-ab62-6be55c664dd5 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:48.803713 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7be1629e-a0d1-4370-ab62-6be55c664dd5 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:48.804160 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7be1629e-a0d1-4370-ab62-6be55c664dd5 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:48.804576 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7be1629e-a0d1-4370-ab62-6be55c664dd5 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:48.948551 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-7be1629e-a0d1-4370-ab62-6be55c664dd5 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:48.956286 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-7be1629e-a0d1-4370-ab62-6be55c664dd5 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1258 microversion: 2.1 time: 0.166141 Aug 19 21:16:48.956852 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 359/788] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:48 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:16:49.976924 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ffe93928-8ded-4d83-b72a-24720d64fd7e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:49.977925 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ffe93928-8ded-4d83-b72a-24720d64fd7e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:49.986187 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ffe93928-8ded-4d83-b72a-24720d64fd7e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:49.986683 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ffe93928-8ded-4d83-b72a-24720d64fd7e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:49.987114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ffe93928-8ded-4d83-b72a-24720d64fd7e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:49.987814 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ffe93928-8ded-4d83-b72a-24720d64fd7e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:49.988280 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ffe93928-8ded-4d83-b72a-24720d64fd7e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:49.988683 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ffe93928-8ded-4d83-b72a-24720d64fd7e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:50.138562 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ffe93928-8ded-4d83-b72a-24720d64fd7e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:50.148892 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ffe93928-8ded-4d83-b72a-24720d64fd7e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1258 microversion: 2.1 time: 0.175807 Aug 19 21:16:50.149796 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 430/789] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:49 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:16:50.965160 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-71f17335-58bb-4614-8859-56957f287097 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f62d950f-3d86-469a-a1ff-65f0582764c8"}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:16:50.967495 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-71f17335-58bb-4614-8859-56957f287097 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:50.974218 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71f17335-58bb-4614-8859-56957f287097 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:50.974707 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71f17335-58bb-4614-8859-56957f287097 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:50.975133 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71f17335-58bb-4614-8859-56957f287097 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:50.975828 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71f17335-58bb-4614-8859-56957f287097 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:50.976278 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71f17335-58bb-4614-8859-56957f287097 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:50.976695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-71f17335-58bb-4614-8859-56957f287097 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:51.171239 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-171c0e71-e131-42f7-9ad0-e0ac21ead341 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:51.172163 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-171c0e71-e131-42f7-9ad0-e0ac21ead341 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:51.180985 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-171c0e71-e131-42f7-9ad0-e0ac21ead341 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:51.181651 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-171c0e71-e131-42f7-9ad0-e0ac21ead341 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:51.182496 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-171c0e71-e131-42f7-9ad0-e0ac21ead341 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:51.183457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-171c0e71-e131-42f7-9ad0-e0ac21ead341 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:51.184234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-171c0e71-e131-42f7-9ad0-e0ac21ead341 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:51.184685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-171c0e71-e131-42f7-9ad0-e0ac21ead341 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:51.248343 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-71f17335-58bb-4614-8859-56957f287097 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "POST /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287211 Aug 19 21:16:51.249114 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 360/790] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Aug 19 21:16:50 2022] POST /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:16:51.361383 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-171c0e71-e131-42f7-9ad0-e0ac21ead341 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:51.370677 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-171c0e71-e131-42f7-9ad0-e0ac21ead341 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1258 microversion: 2.1 time: 0.203688 Aug 19 21:16:51.371634 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 431/791] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:51 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1258 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:16:52.404428 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-e022b989-9c5d-4d02-93fb-95003453ea72 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:52.407778 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-e022b989-9c5d-4d02-93fb-95003453ea72 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:52.422725 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e022b989-9c5d-4d02-93fb-95003453ea72 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:52.423820 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e022b989-9c5d-4d02-93fb-95003453ea72 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:52.424619 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e022b989-9c5d-4d02-93fb-95003453ea72 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:52.426339 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e022b989-9c5d-4d02-93fb-95003453ea72 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:52.427438 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e022b989-9c5d-4d02-93fb-95003453ea72 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:52.428572 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e022b989-9c5d-4d02-93fb-95003453ea72 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:52.617857 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-e022b989-9c5d-4d02-93fb-95003453ea72 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:52.626776 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-e022b989-9c5d-4d02-93fb-95003453ea72 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1258 microversion: 2.1 time: 0.234851 Aug 19 21:16:52.627362 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 361/792] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:52 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1258 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:16:53.649084 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-6d185ecf-e762-4c5e-b043-7e44198be8c1 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:53.650219 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-6d185ecf-e762-4c5e-b043-7e44198be8c1 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:53.657351 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6d185ecf-e762-4c5e-b043-7e44198be8c1 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:53.657875 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6d185ecf-e762-4c5e-b043-7e44198be8c1 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:53.658343 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6d185ecf-e762-4c5e-b043-7e44198be8c1 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:53.659056 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6d185ecf-e762-4c5e-b043-7e44198be8c1 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:53.659508 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6d185ecf-e762-4c5e-b043-7e44198be8c1 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:53.659931 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6d185ecf-e762-4c5e-b043-7e44198be8c1 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:53.809616 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-6d185ecf-e762-4c5e-b043-7e44198be8c1 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:53.818092 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-6d185ecf-e762-4c5e-b043-7e44198be8c1 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1258 microversion: 2.1 time: 0.172898 Aug 19 21:16:53.818679 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 432/793] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:53 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:16:54.373903 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-9202945e-ed0f-4e35-a885-584ee7afbb3b req-e08649a6-64f5-4973-ada1-aa1127f36dcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84087b72-4e56-413e-b975-c23f9f79d0d0", "name": "network-vif-plugged", "status": "completed", "tag": "702f349d-7673-4c52-a88b-8c4ef8a04aa4"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:16:54.394547 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-9202945e-ed0f-4e35-a885-584ee7afbb3b req-e08649a6-64f5-4973-ada1-aa1127f36dcb service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:54.395239 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-9202945e-ed0f-4e35-a885-584ee7afbb3b req-e08649a6-64f5-4973-ada1-aa1127f36dcb service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:54.395755 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-9202945e-ed0f-4e35-a885-584ee7afbb3b req-e08649a6-64f5-4973-ada1-aa1127f36dcb service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:54.412960 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-9202945e-ed0f-4e35-a885-584ee7afbb3b req-e08649a6-64f5-4973-ada1-aa1127f36dcb service nova] Creating event network-vif-plugged:702f349d-7673-4c52-a88b-8c4ef8a04aa4 for instance 84087b72-4e56-413e-b975-c23f9f79d0d0 on hv-cinder-85220 Aug 19 21:16:54.419921 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-9202945e-ed0f-4e35-a885-584ee7afbb3b req-e08649a6-64f5-4973-ada1-aa1127f36dcb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055273 Aug 19 21:16:54.420930 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 362/794] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:16:54.843735 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a56cddea-f75b-40fe-b256-fea63de309ea tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:54.844352 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-a56cddea-f75b-40fe-b256-fea63de309ea tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:54.851133 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a56cddea-f75b-40fe-b256-fea63de309ea tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:54.851632 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a56cddea-f75b-40fe-b256-fea63de309ea tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:54.852064 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a56cddea-f75b-40fe-b256-fea63de309ea tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:54.853541 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a56cddea-f75b-40fe-b256-fea63de309ea tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:54.854073 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a56cddea-f75b-40fe-b256-fea63de309ea tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:54.854622 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a56cddea-f75b-40fe-b256-fea63de309ea tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:55.093665 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-a56cddea-f75b-40fe-b256-fea63de309ea tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:55.101055 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-a56cddea-f75b-40fe-b256-fea63de309ea tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1258 microversion: 2.1 time: 0.261133 Aug 19 21:16:55.102003 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 433/795] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:54 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1258 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:16:56.125692 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-70f8dfe6-eb36-44bf-8fe3-c617aa459fcd tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:56.126561 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-70f8dfe6-eb36-44bf-8fe3-c617aa459fcd tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:56.134945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-70f8dfe6-eb36-44bf-8fe3-c617aa459fcd tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:56.135732 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-70f8dfe6-eb36-44bf-8fe3-c617aa459fcd tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:56.135875 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-70f8dfe6-eb36-44bf-8fe3-c617aa459fcd tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:56.136791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-70f8dfe6-eb36-44bf-8fe3-c617aa459fcd tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:56.137414 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-70f8dfe6-eb36-44bf-8fe3-c617aa459fcd tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:56.138218 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-70f8dfe6-eb36-44bf-8fe3-c617aa459fcd tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:56.285700 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-70f8dfe6-eb36-44bf-8fe3-c617aa459fcd tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:56.294791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-70f8dfe6-eb36-44bf-8fe3-c617aa459fcd tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1258 microversion: 2.1 time: 0.173156 Aug 19 21:16:56.295385 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 363/796] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:56 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:16:57.316536 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-18357210-1bd0-4625-8322-0e2ea6fef4e0 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:57.317190 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-18357210-1bd0-4625-8322-0e2ea6fef4e0 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:57.324126 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-18357210-1bd0-4625-8322-0e2ea6fef4e0 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:57.324627 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-18357210-1bd0-4625-8322-0e2ea6fef4e0 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:57.325066 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-18357210-1bd0-4625-8322-0e2ea6fef4e0 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:57.325804 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-18357210-1bd0-4625-8322-0e2ea6fef4e0 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:57.326411 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-18357210-1bd0-4625-8322-0e2ea6fef4e0 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:57.326844 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-18357210-1bd0-4625-8322-0e2ea6fef4e0 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:57.493853 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-18357210-1bd0-4625-8322-0e2ea6fef4e0 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:57.502206 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-18357210-1bd0-4625-8322-0e2ea6fef4e0 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1443 microversion: 2.1 time: 0.189618 Aug 19 21:16:57.502782 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 434/797] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:57 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1443 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:16:57.526206 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-8c0f67a7-3ed9-4ec9-a608-c15f838e38ee tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:57.527386 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-8c0f67a7-3ed9-4ec9-a608-c15f838e38ee tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:57.536095 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8c0f67a7-3ed9-4ec9-a608-c15f838e38ee tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:57.536745 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8c0f67a7-3ed9-4ec9-a608-c15f838e38ee tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:57.537408 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8c0f67a7-3ed9-4ec9-a608-c15f838e38ee tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:57.538472 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8c0f67a7-3ed9-4ec9-a608-c15f838e38ee tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:57.539165 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8c0f67a7-3ed9-4ec9-a608-c15f838e38ee tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:57.539599 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8c0f67a7-3ed9-4ec9-a608-c15f838e38ee tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:57.700804 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-8c0f67a7-3ed9-4ec9-a608-c15f838e38ee tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:16:57.709591 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-8c0f67a7-3ed9-4ec9-a608-c15f838e38ee tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1443 microversion: 2.1 time: 0.189894 Aug 19 21:16:57.710215 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 364/798] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:16:57 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1443 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:16:58.977706 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a2d9a8a5-b9b6-4fef-9660-652548312837 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f62d950f-3d86-469a-a1ff-65f0582764c8"}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:16:58.980339 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-a2d9a8a5-b9b6-4fef-9660-652548312837 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:58.987868 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a2d9a8a5-b9b6-4fef-9660-652548312837 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:58.988362 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a2d9a8a5-b9b6-4fef-9660-652548312837 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:58.988801 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a2d9a8a5-b9b6-4fef-9660-652548312837 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:58.989522 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a2d9a8a5-b9b6-4fef-9660-652548312837 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:58.990017 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a2d9a8a5-b9b6-4fef-9660-652548312837 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:58.990448 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a2d9a8a5-b9b6-4fef-9660-652548312837 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:59.091848 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-a2d9a8a5-b9b6-4fef-9660-652548312837 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] HTTP exception thrown: Invalid volume: volume f62d950f-3d86-469a-a1ff-65f0582764c8 is already attached to instances: 26867181-b826-417c-a967-774b70a8d82f Aug 19 21:16:59.093731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a2d9a8a5-b9b6-4fef-9660-652548312837 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Request method failure captured: Aug 19 21:16:59.093731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: POST /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f/os-volume_attachments HTTP/1.1 Aug 19 21:16:59.093731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:16:59.093731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:16:59.093731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:16:59.093731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 74 Aug 19 21:16:59.093731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:16:59.093731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:16:59.093731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:16:59.093731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:16:59.093731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__vTnxy0ZuRvCXYQHvdPUOIQ6IB7Tloqeiky5Yoiyt0Vgpb02m5mw3a2DEvQ0XyB7szWj5fdMvWapGqmCGDv7CfrB3Py-zgdnjUuiEJx19vEpXywPa2SVjntZLwoFOFk2XhitOUTwaBJ37dbyUmN2puMJZysaOLWl8Nrh88xp2dULAg Aug 19 21:16:59.093731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:16:59.093731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:16:59.093731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:16:59.093731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:16:59.093731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:16:59.093731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:16:59.093731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:16:59.093731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:16:59.093731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:16:59.093731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:16:59.095330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:16:59.095330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:16:59.095330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:16:59.095330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:16:59.095330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:16:59.095330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:16:59.095330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:16:59.095330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: 7f46019e78cc4e89bf877a4f5a7a8fe9 Aug 19 21:16:59.095330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:16:59.095330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Aug 19 21:16:59.095330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {"volumeAttachment": {"volumeId": "f62d950f-3d86-469a-a1ff-65f0582764c8"}} Aug 19 21:16:59.095330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: > Aug 19 21:16:59.096101 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Invalid volume: volume f62d950f-3d86-469a-a1ff-65f0582764c8 is already attached to instances: 26867181-b826-417c-a967-774b70a8d82f Aug 19 21:16:59.096101 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'server_id': '26867181-b826-417c-a967-774b70a8d82f', 'body': {'volumeAttachment': {'volumeId': 'f62d950f-3d86-469a-a1ff-65f0582764c8'}}} Aug 19 21:16:59.096101 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:16:59.096101 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:16:59.096101 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 19 21:16:59.096101 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 19 21:16:59.096101 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 19 21:16:59.096101 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 19 21:16:59.096101 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 19 21:16:59.096101 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 19 21:16:59.096101 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5119, in attach_volume Aug 19 21:16:59.096101 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 19 21:16:59.096101 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4959, in _check_volume_already_attached Aug 19 21:16:59.096101 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 19 21:16:59.096101 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f62d950f-3d86-469a-a1ff-65f0582764c8 is already attached to instances: 26867181-b826-417c-a967-774b70a8d82f Aug 19 21:16:59.096101 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:16:59.096101 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:16:59.096101 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:16:59.096101 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:16:59.097330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:16:59.097330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:16:59.097330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:16:59.097330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:16:59.097330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:16:59.097330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:16:59.097330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 21:16:59.097330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 21:16:59.097330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 21:16:59.097330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 21:16:59.097330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 21:16:59.097330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 21:16:59.097330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 19 21:16:59.097330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 19 21:16:59.097330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f62d950f-3d86-469a-a1ff-65f0582764c8 is already attached to instances: 26867181-b826-417c-a967-774b70a8d82f Aug 19 21:16:59.097330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:16:59.097330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:16:59.097330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:16:59.097330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:16:59.097330 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:16:59.102160 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:16:59.102160 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:16:59.102160 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:16:59.102160 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f62d950f-3d86-469a-a1ff-65f0582764c8 is already attached to instances: 26867181-b826-417c-a967-774b70a8d82f Aug 19 21:16:59.102160 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:16:59.102160 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a2d9a8a5-b9b6-4fef-9660-652548312837 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Returning 400 to user: Invalid volume: volume f62d950f-3d86-469a-a1ff-65f0582764c8 is already attached to instances: 26867181-b826-417c-a967-774b70a8d82f {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:16:59.102160 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-a2d9a8a5-b9b6-4fef-9660-652548312837 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "POST /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.123519 Aug 19 21:16:59.102160 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 435/799] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Aug 19 21:16:58 2022] POST /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f/os-volume_attachments => generated 174 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 19 21:16:59.175127 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-3b1732e1-04a1-4cf8-ad84-b1633c9dedca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:59.175691 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-3b1732e1-04a1-4cf8-ad84-b1633c9dedca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:59.183472 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3b1732e1-04a1-4cf8-ad84-b1633c9dedca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:59.183965 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3b1732e1-04a1-4cf8-ad84-b1633c9dedca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:59.184399 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3b1732e1-04a1-4cf8-ad84-b1633c9dedca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:59.185200 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3b1732e1-04a1-4cf8-ad84-b1633c9dedca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:59.185661 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3b1732e1-04a1-4cf8-ad84-b1633c9dedca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:59.186337 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3b1732e1-04a1-4cf8-ad84-b1633c9dedca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:59.289592 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.objects.instance [None req-3b1732e1-04a1-4cf8-ad84-b1633c9dedca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lazy-loading 'services' on Instance uuid 26867181-b826-417c-a967-774b70a8d82f {{(pid=120876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:16:59.532731 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-3b1732e1-04a1-4cf8-ad84-b1633c9dedca tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "DELETE /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f/os-volume_attachments/f62d950f-3d86-469a-a1ff-65f0582764c8" status: 202 len: 0 microversion: 2.1 time: 0.360978 Aug 19 21:16:59.547806 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-9d2f8cbd-5d73-4053-a7cb-dcff54964265 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:16:59.548951 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 365/800] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Aug 19 21:16:59 2022] DELETE /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f/os-volume_attachments/f62d950f-3d86-469a-a1ff-65f0582764c8 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:16:59.552721 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-9d2f8cbd-5d73-4053-a7cb-dcff54964265 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:16:59.562766 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:59.566096 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9d2f8cbd-5d73-4053-a7cb-dcff54964265 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:59.566756 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9d2f8cbd-5d73-4053-a7cb-dcff54964265 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:59.567207 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9d2f8cbd-5d73-4053-a7cb-dcff54964265 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:59.568341 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9d2f8cbd-5d73-4053-a7cb-dcff54964265 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:16:59.568836 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9d2f8cbd-5d73-4053-a7cb-dcff54964265 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:16:59.569414 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9d2f8cbd-5d73-4053-a7cb-dcff54964265 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:16:59.576683 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=93 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:16:59.633034 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-9d2f8cbd-5d73-4053-a7cb-dcff54964265 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093932 Aug 19 21:16:59.633621 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 436/801] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Aug 19 21:16:59 2022] GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:17:00.220982 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-f33f619a-f0a2-4b9a-8622-84675af9160c req-19782084-923f-4df3-af82-ddd0224d552b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84087b72-4e56-413e-b975-c23f9f79d0d0", "tag": "702f349d-7673-4c52-a88b-8c4ef8a04aa4"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:17:00.227211 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=35 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:00.236637 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-f33f619a-f0a2-4b9a-8622-84675af9160c req-19782084-923f-4df3-af82-ddd0224d552b service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:00.237326 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-f33f619a-f0a2-4b9a-8622-84675af9160c req-19782084-923f-4df3-af82-ddd0224d552b service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:00.237956 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-f33f619a-f0a2-4b9a-8622-84675af9160c req-19782084-923f-4df3-af82-ddd0224d552b service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:00.249557 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:00.253680 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-f33f619a-f0a2-4b9a-8622-84675af9160c req-19782084-923f-4df3-af82-ddd0224d552b service nova] Creating event network-changed:702f349d-7673-4c52-a88b-8c4ef8a04aa4 for instance 84087b72-4e56-413e-b975-c23f9f79d0d0 on hv-cinder-85220 Aug 19 21:17:00.259563 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-f33f619a-f0a2-4b9a-8622-84675af9160c req-19782084-923f-4df3-af82-ddd0224d552b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043183 Aug 19 21:17:00.260621 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 366/802] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:17:00.648548 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e76db467-ccc3-44d0-9c7b-b4b6cf0fc15d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:00.653314 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-e76db467-ccc3-44d0-9c7b-b4b6cf0fc15d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:00.663795 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e76db467-ccc3-44d0-9c7b-b4b6cf0fc15d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:00.664378 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e76db467-ccc3-44d0-9c7b-b4b6cf0fc15d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:00.666048 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e76db467-ccc3-44d0-9c7b-b4b6cf0fc15d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:00.667889 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e76db467-ccc3-44d0-9c7b-b4b6cf0fc15d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:00.669418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e76db467-ccc3-44d0-9c7b-b4b6cf0fc15d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:00.670656 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e76db467-ccc3-44d0-9c7b-b4b6cf0fc15d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:00.716398 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e76db467-ccc3-44d0-9c7b-b4b6cf0fc15d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073683 Aug 19 21:17:00.717677 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 437/803] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Aug 19 21:17:00 2022] GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 21:17:00.812807 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-3a5a4266-de87-488d-83b9-c3aa2e64403f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:00.813563 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-3a5a4266-de87-488d-83b9-c3aa2e64403f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:00.823249 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3a5a4266-de87-488d-83b9-c3aa2e64403f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:00.824076 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3a5a4266-de87-488d-83b9-c3aa2e64403f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:00.825303 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3a5a4266-de87-488d-83b9-c3aa2e64403f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:00.826467 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3a5a4266-de87-488d-83b9-c3aa2e64403f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:00.827173 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3a5a4266-de87-488d-83b9-c3aa2e64403f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:00.827805 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3a5a4266-de87-488d-83b9-c3aa2e64403f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:00.878568 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-3a5a4266-de87-488d-83b9-c3aa2e64403f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Going to try to terminate instance {{(pid=120876) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 21:17:01.011154 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-3a5a4266-de87-488d-83b9-c3aa2e64403f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "DELETE /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f" status: 204 len: 0 microversion: 2.1 time: 0.198765 Aug 19 21:17:01.014284 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 367/804] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:17:00 2022] DELETE /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 21:17:01.023251 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-fbc7960e-9c0b-4fe1-9c1b-52ab3690e08a tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:01.023880 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-fbc7960e-9c0b-4fe1-9c1b-52ab3690e08a tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:01.031049 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fbc7960e-9c0b-4fe1-9c1b-52ab3690e08a tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:01.031831 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fbc7960e-9c0b-4fe1-9c1b-52ab3690e08a tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:01.032433 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fbc7960e-9c0b-4fe1-9c1b-52ab3690e08a tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:01.033340 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fbc7960e-9c0b-4fe1-9c1b-52ab3690e08a tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:01.034050 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fbc7960e-9c0b-4fe1-9c1b-52ab3690e08a tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:01.034634 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fbc7960e-9c0b-4fe1-9c1b-52ab3690e08a tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:01.198126 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-fbc7960e-9c0b-4fe1-9c1b-52ab3690e08a tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:01.208314 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-fbc7960e-9c0b-4fe1-9c1b-52ab3690e08a tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f" status: 200 len: 1682 microversion: 2.1 time: 0.188991 Aug 19 21:17:01.208973 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 438/805] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:17:01 2022] GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:17:02.232819 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-70aca867-e06d-4698-8c1d-d69764e6f62e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:02.233614 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-70aca867-e06d-4698-8c1d-d69764e6f62e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:02.240176 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-70aca867-e06d-4698-8c1d-d69764e6f62e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:02.240743 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-70aca867-e06d-4698-8c1d-d69764e6f62e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:02.241249 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-70aca867-e06d-4698-8c1d-d69764e6f62e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:02.242140 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-70aca867-e06d-4698-8c1d-d69764e6f62e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:02.242851 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-70aca867-e06d-4698-8c1d-d69764e6f62e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:02.249098 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-70aca867-e06d-4698-8c1d-d69764e6f62e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:02.393714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-70aca867-e06d-4698-8c1d-d69764e6f62e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:02.403319 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-70aca867-e06d-4698-8c1d-d69764e6f62e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f" status: 200 len: 1682 microversion: 2.1 time: 0.176522 Aug 19 21:17:02.403894 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 368/806] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:17:02 2022] GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:17:03.428466 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e3b4d444-2a6e-4456-92fd-099cb780d602 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:03.430366 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-e3b4d444-2a6e-4456-92fd-099cb780d602 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:03.439881 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e3b4d444-2a6e-4456-92fd-099cb780d602 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:03.440379 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e3b4d444-2a6e-4456-92fd-099cb780d602 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:03.441102 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e3b4d444-2a6e-4456-92fd-099cb780d602 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:03.441981 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e3b4d444-2a6e-4456-92fd-099cb780d602 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:03.442468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e3b4d444-2a6e-4456-92fd-099cb780d602 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:03.442886 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e3b4d444-2a6e-4456-92fd-099cb780d602 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:03.605702 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e3b4d444-2a6e-4456-92fd-099cb780d602 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:03.615265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e3b4d444-2a6e-4456-92fd-099cb780d602 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f" status: 200 len: 1682 microversion: 2.1 time: 0.193394 Aug 19 21:17:03.615839 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 439/807] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:17:03 2022] GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f => generated 1682 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:17:04.048145 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-c51601c6-c995-4f1a-a9ad-75ff8ed40018 req-633dc668-d901-4731-831a-ebe3b65dc89d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26867181-b826-417c-a967-774b70a8d82f", "name": "network-vif-deleted", "tag": "59d9bc76-b59c-49ce-867d-9117c6cdb516"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:17:04.061827 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-c51601c6-c995-4f1a-a9ad-75ff8ed40018 req-633dc668-d901-4731-831a-ebe3b65dc89d service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:04.062399 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-c51601c6-c995-4f1a-a9ad-75ff8ed40018 req-633dc668-d901-4731-831a-ebe3b65dc89d service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:04.062821 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-c51601c6-c995-4f1a-a9ad-75ff8ed40018 req-633dc668-d901-4731-831a-ebe3b65dc89d service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:04.078302 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-c51601c6-c995-4f1a-a9ad-75ff8ed40018 req-633dc668-d901-4731-831a-ebe3b65dc89d service nova] Creating event network-vif-deleted:59d9bc76-b59c-49ce-867d-9117c6cdb516 for instance 26867181-b826-417c-a967-774b70a8d82f on hv-cinder-85220 Aug 19 21:17:04.090794 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-c51601c6-c995-4f1a-a9ad-75ff8ed40018 req-633dc668-d901-4731-831a-ebe3b65dc89d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045133 Aug 19 21:17:04.091304 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 369/808] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:17:04.644543 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-76a7818d-ed7c-4823-8156-3389b739d923 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:04.646198 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-76a7818d-ed7c-4823-8156-3389b739d923 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:04.657478 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-76a7818d-ed7c-4823-8156-3389b739d923 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:04.659103 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-76a7818d-ed7c-4823-8156-3389b739d923 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:04.659734 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-76a7818d-ed7c-4823-8156-3389b739d923 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:04.660645 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-76a7818d-ed7c-4823-8156-3389b739d923 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:04.661462 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-76a7818d-ed7c-4823-8156-3389b739d923 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:04.662208 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-76a7818d-ed7c-4823-8156-3389b739d923 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:04.726727 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-76a7818d-ed7c-4823-8156-3389b739d923 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:04.730538 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-76a7818d-ed7c-4823-8156-3389b739d923 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:04.731194 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-76a7818d-ed7c-4823-8156-3389b739d923 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:04.731736 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.objects.instance [None req-76a7818d-ed7c-4823-8156-3389b739d923 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lazy-loading 'fault' on Instance uuid 26867181-b826-417c-a967-774b70a8d82f {{(pid=120877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:17:04.783721 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-76a7818d-ed7c-4823-8156-3389b739d923 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:04.792963 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-76a7818d-ed7c-4823-8156-3389b739d923 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f" status: 200 len: 1332 microversion: 2.1 time: 0.155391 Aug 19 21:17:04.793853 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 440/809] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:17:04 2022] GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f => generated 1332 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:17:05.817136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-2b319bc0-5c40-4aaa-a693-832726b38549 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:05.818366 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-2b319bc0-5c40-4aaa-a693-832726b38549 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:05.825172 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2b319bc0-5c40-4aaa-a693-832726b38549 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:05.825668 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2b319bc0-5c40-4aaa-a693-832726b38549 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:05.826134 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2b319bc0-5c40-4aaa-a693-832726b38549 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:05.826823 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2b319bc0-5c40-4aaa-a693-832726b38549 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:05.827277 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2b319bc0-5c40-4aaa-a693-832726b38549 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:05.827697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2b319bc0-5c40-4aaa-a693-832726b38549 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:05.845608 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-2b319bc0-5c40-4aaa-a693-832726b38549 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] HTTP exception thrown: Instance 26867181-b826-417c-a967-774b70a8d82f could not be found. Aug 19 21:17:05.847423 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-2b319bc0-5c40-4aaa-a693-832726b38549 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Request method failure captured: Aug 19 21:17:05.847423 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f HTTP/1.1 Aug 19 21:17:05.847423 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:17:05.847423 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:17:05.847423 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:17:05.847423 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:17:05.847423 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:17:05.847423 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:17:05.847423 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:17:05.847423 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:17:05.847423 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__vTnxy0ZuRvCXYQHvdPUOIQ6IB7Tloqeiky5Yoiyt0Vgpb02m5mw3a2DEvQ0XyB7szWj5fdMvWapGqmCGDv7CfrB3Py-zgdnjUuiEJx19vEpXywPa2SVjntZLwoFOFk2XhitOUTwaBJ37dbyUmN2puMJZysaOLWl8Nrh88xp2dULAg Aug 19 21:17:05.847423 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:17:05.847423 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:17:05.847423 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:17:05.847423 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:17:05.847423 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:17:05.847423 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:17:05.847423 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:17:05.847423 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:17:05.847423 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:17:05.847423 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:17:05.850216 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:17:05.850216 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:17:05.850216 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:17:05.850216 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:17:05.850216 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:17:05.850216 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:17:05.850216 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:17:05.850216 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: 7f46019e78cc4e89bf877a4f5a7a8fe9 Aug 19 21:17:05.850216 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:17:05.850216 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: > Aug 19 21:17:05.850216 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Instance 26867181-b826-417c-a967-774b70a8d82f could not be found. Aug 19 21:17:05.850216 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': '26867181-b826-417c-a967-774b70a8d82f'} Aug 19 21:17:05.851736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:17:05.851736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:17:05.851736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:17:05.851736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:17:05.851736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:17:05.851736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:17:05.851736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:17:05.851736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:17:05.851736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:17:05.851736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:17:05.851736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26867181-b826-417c-a967-774b70a8d82f could not be found. Aug 19 21:17:05.851736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:17:05.851736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:17:05.851736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:17:05.851736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:17:05.851736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:17:05.851736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:17:05.851736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:17:05.851736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:17:05.851736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:17:05.854902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:17:05.854902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:17:05.854902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:17:05.854902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:17:05.854902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:17:05.854902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:17:05.854902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:17:05.854902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26867181-b826-417c-a967-774b70a8d82f could not be found. Aug 19 21:17:05.854902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:17:05.854902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:17:05.854902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:17:05.854902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:17:05.854902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:17:05.854902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:17:05.854902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:17:05.854902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:17:05.854902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26867181-b826-417c-a967-774b70a8d82f could not be found. Aug 19 21:17:05.854902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:17:05.857187 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-2b319bc0-5c40-4aaa-a693-832726b38549 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Returning 404 to user: Instance 26867181-b826-417c-a967-774b70a8d82f could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:17:05.857187 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-2b319bc0-5c40-4aaa-a693-832726b38549 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f" status: 404 len: 111 microversion: 2.1 time: 0.036731 Aug 19 21:17:05.857187 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 370/810] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:17:05 2022] GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:17:05.860564 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-41c54f2f-b87a-4d57-abc0-7f753d404ebb tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '.version_select at 0x7f740bb02430>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:05.888560 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-41c54f2f-b87a-4d57-abc0-7f753d404ebb tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458425416" status: 202 len: 0 microversion: 2.1 time: 0.031296 Aug 19 21:17:05.891067 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 441/811] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Aug 19 21:17:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458425416 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:17:06.662219 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-1422beca-5103-44c0-8abd-16ff5621d95d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Action: 'create', calling method: .version_select at 0x7f740bb8a670>, body: {"keypair": {"name": "tempest-keypair-1544952583", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8n32qPfagUOo2Fopxg/gltKtLCuhFpCyBmvDkJLrKcoCVtNSkEW6WhncblBDR59a4Bk1agzV2kp6XML4wyfYrInkb5mOpahTWaFJHbWQcVB6CPYqnGv3ElV0shhgX2qA=="}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:17:06.685062 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-1422beca-5103-44c0-8abd-16ff5621d95d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Getting quotas for project 358e50f9b9df43b7aa0a4ba1353e4a25. Resources: {'key_pairs'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:17:06.689642 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-1422beca-5103-44c0-8abd-16ff5621d95d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Getting quotas for user 7f46019e78cc4e89bf877a4f5a7a8fe9 and project 358e50f9b9df43b7aa0a4ba1353e4a25. Resources: {'key_pairs'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:17:06.714307 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-1422beca-5103-44c0-8abd-16ff5621d95d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059993 Aug 19 21:17:06.715086 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 371/812] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Aug 19 21:17:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:17:08.356845 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-26acbcaf-2a1d-42cd-9a8c-5a5b81aa1b24 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1410424671", "imageRef": "d1f034cf-f103-477b-bbb5-3298c678db05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b0fd483-0b8c-45b1-8b1c-2c76848b5463"}], "security_groups": [{"name": "tempest-securitygroup--451686322"}], "key_name": "tempest-keypair-1544952583", "user_data": "}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:17:08.479683 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.network.neutron [None req-26acbcaf-2a1d-42cd-9a8c-5a5b81aa1b24 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] validate_networks() for [('8b0fd483-0b8c-45b1-8b1c-2c76848b5463', None, None, None, None, None)] {{(pid=120877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 21:17:08.913631 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-26acbcaf-2a1d-42cd-9a8c-5a5b81aa1b24 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Flavor limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 21:17:08.914104 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-26acbcaf-2a1d-42cd-9a8c-5a5b81aa1b24 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Image limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 21:17:08.914574 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-26acbcaf-2a1d-42cd-9a8c-5a5b81aa1b24 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Flavor pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 21:17:08.915488 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-26acbcaf-2a1d-42cd-9a8c-5a5b81aa1b24 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Image pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 21:17:08.915895 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-26acbcaf-2a1d-42cd-9a8c-5a5b81aa1b24 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 21:17:08.925229 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-26acbcaf-2a1d-42cd-9a8c-5a5b81aa1b24 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:08.925716 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-26acbcaf-2a1d-42cd-9a8c-5a5b81aa1b24 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:08.926194 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-26acbcaf-2a1d-42cd-9a8c-5a5b81aa1b24 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:08.926929 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-26acbcaf-2a1d-42cd-9a8c-5a5b81aa1b24 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:08.927389 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-26acbcaf-2a1d-42cd-9a8c-5a5b81aa1b24 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:08.927817 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-26acbcaf-2a1d-42cd-9a8c-5a5b81aa1b24 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:08.953526 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-26acbcaf-2a1d-42cd-9a8c-5a5b81aa1b24 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Getting quotas for project 358e50f9b9df43b7aa0a4ba1353e4a25. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:17:08.957533 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-26acbcaf-2a1d-42cd-9a8c-5a5b81aa1b24 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Getting quotas for user 7f46019e78cc4e89bf877a4f5a7a8fe9 and project 358e50f9b9df43b7aa0a4ba1353e4a25. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:17:08.975981 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-26acbcaf-2a1d-42cd-9a8c-5a5b81aa1b24 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Going to run 1 instances... {{(pid=120877) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 21:17:08.978792 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-26acbcaf-2a1d-42cd-9a8c-5a5b81aa1b24 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f034cf-f103-477b-bbb5-3298c678db05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 21:17:09.028504 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-26acbcaf-2a1d-42cd-9a8c-5a5b81aa1b24 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.678211 Aug 19 21:17:09.029263 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 442/813] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Aug 19 21:17:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 21:17:09.041551 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-cd323c6f-f53a-4586-8730-13b2d2bd54c3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:09.042353 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-cd323c6f-f53a-4586-8730-13b2d2bd54c3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:09.109135 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-cd323c6f-f53a-4586-8730-13b2d2bd54c3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:09.116817 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-cd323c6f-f53a-4586-8730-13b2d2bd54c3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5" status: 200 len: 1242 microversion: 2.1 time: 0.080374 Aug 19 21:17:09.117397 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 372/814] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:17:09 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:17:10.138571 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c20e61be-acbd-4c56-9687-1c9cadefe651 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:10.139794 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-c20e61be-acbd-4c56-9687-1c9cadefe651 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:10.148010 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c20e61be-acbd-4c56-9687-1c9cadefe651 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:10.148735 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c20e61be-acbd-4c56-9687-1c9cadefe651 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:10.149170 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c20e61be-acbd-4c56-9687-1c9cadefe651 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:10.150263 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c20e61be-acbd-4c56-9687-1c9cadefe651 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:10.150886 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c20e61be-acbd-4c56-9687-1c9cadefe651 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:10.152130 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c20e61be-acbd-4c56-9687-1c9cadefe651 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:10.236748 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c20e61be-acbd-4c56-9687-1c9cadefe651 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:10.248017 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-c20e61be-acbd-4c56-9687-1c9cadefe651 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5" status: 200 len: 1302 microversion: 2.1 time: 0.113874 Aug 19 21:17:10.249641 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 443/815] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:17:10 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 => generated 1302 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:17:11.272026 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-94992a07-31ef-425c-8fb1-a6bf41268434 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:11.275288 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-94992a07-31ef-425c-8fb1-a6bf41268434 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:11.279967 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-9978941d-1fa6-4509-b8e6-78267c0e4004 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:11.280465 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-9978941d-1fa6-4509-b8e6-78267c0e4004 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:11.287351 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9978941d-1fa6-4509-b8e6-78267c0e4004 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:11.287553 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-94992a07-31ef-425c-8fb1-a6bf41268434 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:11.287838 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9978941d-1fa6-4509-b8e6-78267c0e4004 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:11.287952 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-94992a07-31ef-425c-8fb1-a6bf41268434 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:11.288276 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9978941d-1fa6-4509-b8e6-78267c0e4004 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:11.288392 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-94992a07-31ef-425c-8fb1-a6bf41268434 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:11.288972 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9978941d-1fa6-4509-b8e6-78267c0e4004 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:11.289080 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-94992a07-31ef-425c-8fb1-a6bf41268434 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:11.289425 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9978941d-1fa6-4509-b8e6-78267c0e4004 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:11.289545 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-94992a07-31ef-425c-8fb1-a6bf41268434 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:11.290393 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9978941d-1fa6-4509-b8e6-78267c0e4004 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:11.290505 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-94992a07-31ef-425c-8fb1-a6bf41268434 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:11.327621 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-9978941d-1fa6-4509-b8e6-78267c0e4004 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce/ips" status: 200 len: 150 microversion: 2.20 time: 0.051450 Aug 19 21:17:11.328204 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 444/816] 10.222.0.16 () {60 vars in 1289 bytes} [Fri Aug 19 21:17:11 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce/ips => generated 150 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 21:17:11.446663 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-94992a07-31ef-425c-8fb1-a6bf41268434 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:11.459293 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-94992a07-31ef-425c-8fb1-a6bf41268434 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5" status: 200 len: 1367 microversion: 2.1 time: 0.191046 Aug 19 21:17:11.459884 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 373/817] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:17:11 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:17:11.929979 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-65a4dee7-460a-4a0b-aca8-8a5b0314f92d req-a6714c67-f90a-4216-88b2-a786058eb578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5", "tag": "6ee9f12c-0d63-4bb1-9c4a-9f1b917fc468"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:17:11.959973 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-65a4dee7-460a-4a0b-aca8-8a5b0314f92d req-a6714c67-f90a-4216-88b2-a786058eb578 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:11.965824 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-65a4dee7-460a-4a0b-aca8-8a5b0314f92d req-a6714c67-f90a-4216-88b2-a786058eb578 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:11.966878 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-65a4dee7-460a-4a0b-aca8-8a5b0314f92d req-a6714c67-f90a-4216-88b2-a786058eb578 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:11.987019 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-65a4dee7-460a-4a0b-aca8-8a5b0314f92d req-a6714c67-f90a-4216-88b2-a786058eb578 service nova] Creating event network-changed:6ee9f12c-0d63-4bb1-9c4a-9f1b917fc468 for instance c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 on hv-cinder-85220 Aug 19 21:17:11.994303 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-65a4dee7-460a-4a0b-aca8-8a5b0314f92d req-a6714c67-f90a-4216-88b2-a786058eb578 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067282 Aug 19 21:17:11.995546 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 445/818] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:17:12.481191 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-0216c564-8db9-48e9-af10-70a55283f24c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:12.481851 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-0216c564-8db9-48e9-af10-70a55283f24c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:12.488295 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0216c564-8db9-48e9-af10-70a55283f24c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:12.488774 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0216c564-8db9-48e9-af10-70a55283f24c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:12.489203 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0216c564-8db9-48e9-af10-70a55283f24c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:12.489912 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0216c564-8db9-48e9-af10-70a55283f24c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:12.490365 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0216c564-8db9-48e9-af10-70a55283f24c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:12.490784 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0216c564-8db9-48e9-af10-70a55283f24c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:12.625355 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-0216c564-8db9-48e9-af10-70a55283f24c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:12.633018 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-0216c564-8db9-48e9-af10-70a55283f24c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5" status: 200 len: 1367 microversion: 2.1 time: 0.156332 Aug 19 21:17:12.634108 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 374/819] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:17:12 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:17:13.457689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-eb076d8f-6aef-426b-8b81-29052589dd73 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:17:13.458452 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-eb076d8f-6aef-426b-8b81-29052589dd73 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:13.466178 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eb076d8f-6aef-426b-8b81-29052589dd73 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:13.466665 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eb076d8f-6aef-426b-8b81-29052589dd73 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:13.467094 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eb076d8f-6aef-426b-8b81-29052589dd73 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:13.467789 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eb076d8f-6aef-426b-8b81-29052589dd73 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:13.468236 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eb076d8f-6aef-426b-8b81-29052589dd73 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:13.468652 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-eb076d8f-6aef-426b-8b81-29052589dd73 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:13.492843 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.objects.instance [None req-eb076d8f-6aef-426b-8b81-29052589dd73 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lazy-loading 'flavor' on Instance uuid e5be0a3d-0419-4d69-83b2-22939e9c9bce {{(pid=120877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:17:13.655129 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-e6fe5db1-39ef-42f5-bc3e-ff560cd0cc85 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:13.655754 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-e6fe5db1-39ef-42f5-bc3e-ff560cd0cc85 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:13.662503 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e6fe5db1-39ef-42f5-bc3e-ff560cd0cc85 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:13.662986 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e6fe5db1-39ef-42f5-bc3e-ff560cd0cc85 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:13.663418 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e6fe5db1-39ef-42f5-bc3e-ff560cd0cc85 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:13.664114 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e6fe5db1-39ef-42f5-bc3e-ff560cd0cc85 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:13.664568 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e6fe5db1-39ef-42f5-bc3e-ff560cd0cc85 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:13.665727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e6fe5db1-39ef-42f5-bc3e-ff560cd0cc85 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:13.676861 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-eb076d8f-6aef-426b-8b81-29052589dd73 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "POST /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce/action" status: 202 len: 0 microversion: 2.20 time: 0.224704 Aug 19 21:17:13.677469 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 446/820] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Aug 19 21:17:13 2022] POST /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 19 21:17:13.686459 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-03f88095-0076-4ca3-96df-7b7a59db9100 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:13.687251 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-03f88095-0076-4ca3-96df-7b7a59db9100 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:13.693521 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-03f88095-0076-4ca3-96df-7b7a59db9100 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:13.694121 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-03f88095-0076-4ca3-96df-7b7a59db9100 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:13.694644 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-03f88095-0076-4ca3-96df-7b7a59db9100 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:13.695406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-03f88095-0076-4ca3-96df-7b7a59db9100 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:13.695938 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-03f88095-0076-4ca3-96df-7b7a59db9100 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:13.696686 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-03f88095-0076-4ca3-96df-7b7a59db9100 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:13.856262 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-e6fe5db1-39ef-42f5-bc3e-ff560cd0cc85 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:13.864038 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-e6fe5db1-39ef-42f5-bc3e-ff560cd0cc85 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5" status: 200 len: 1367 microversion: 2.1 time: 0.212940 Aug 19 21:17:13.864624 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 375/821] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:17:13 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:17:13.877261 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-03f88095-0076-4ca3-96df-7b7a59db9100 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:13.885965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-03f88095-0076-4ca3-96df-7b7a59db9100 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:13.887494 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-03f88095-0076-4ca3-96df-7b7a59db9100 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:13.888919 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-03f88095-0076-4ca3-96df-7b7a59db9100 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1721 microversion: 2.20 time: 0.206644 Aug 19 21:17:13.889475 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 447/822] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:13 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:17:14.886118 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-91346a30-5ffc-4680-befc-63cf22f9fa5f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:14.888009 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-91346a30-5ffc-4680-befc-63cf22f9fa5f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:14.898574 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-91346a30-5ffc-4680-befc-63cf22f9fa5f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:14.899380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-91346a30-5ffc-4680-befc-63cf22f9fa5f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:14.900372 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-91346a30-5ffc-4680-befc-63cf22f9fa5f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:14.901333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-91346a30-5ffc-4680-befc-63cf22f9fa5f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:14.902265 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-91346a30-5ffc-4680-befc-63cf22f9fa5f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:14.903234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-91346a30-5ffc-4680-befc-63cf22f9fa5f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:14.921411 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-48ea33de-f1d2-44eb-9b5d-f59cc4b7ef8f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:14.926363 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-48ea33de-f1d2-44eb-9b5d-f59cc4b7ef8f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:14.934713 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-48ea33de-f1d2-44eb-9b5d-f59cc4b7ef8f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:14.935532 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-48ea33de-f1d2-44eb-9b5d-f59cc4b7ef8f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:14.936461 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-48ea33de-f1d2-44eb-9b5d-f59cc4b7ef8f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:14.937659 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-48ea33de-f1d2-44eb-9b5d-f59cc4b7ef8f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:14.938461 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-48ea33de-f1d2-44eb-9b5d-f59cc4b7ef8f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:14.939096 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-48ea33de-f1d2-44eb-9b5d-f59cc4b7ef8f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:15.154093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-91346a30-5ffc-4680-befc-63cf22f9fa5f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:15.163800 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-91346a30-5ffc-4680-befc-63cf22f9fa5f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5" status: 200 len: 1367 microversion: 2.1 time: 0.282017 Aug 19 21:17:15.165746 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 376/823] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:17:14 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:17:15.192138 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-48ea33de-f1d2-44eb-9b5d-f59cc4b7ef8f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:15.202917 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-48ea33de-f1d2-44eb-9b5d-f59cc4b7ef8f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:15.204480 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-48ea33de-f1d2-44eb-9b5d-f59cc4b7ef8f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:15.205661 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-48ea33de-f1d2-44eb-9b5d-f59cc4b7ef8f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1721 microversion: 2.20 time: 0.296916 Aug 19 21:17:15.206260 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 448/824] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:14 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1721 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:16.188041 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-2ca480e0-e6e4-4aea-af3c-c5fc8567ed21 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:16.188677 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-2ca480e0-e6e4-4aea-af3c-c5fc8567ed21 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:16.197593 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2ca480e0-e6e4-4aea-af3c-c5fc8567ed21 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:16.198228 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2ca480e0-e6e4-4aea-af3c-c5fc8567ed21 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:16.203054 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2ca480e0-e6e4-4aea-af3c-c5fc8567ed21 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:16.204048 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2ca480e0-e6e4-4aea-af3c-c5fc8567ed21 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:16.204545 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2ca480e0-e6e4-4aea-af3c-c5fc8567ed21 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:16.205121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2ca480e0-e6e4-4aea-af3c-c5fc8567ed21 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:16.233889 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-7c4be83c-fd1a-4ab1-88df-bc72bcd07882 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:16.235523 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-7c4be83c-fd1a-4ab1-88df-bc72bcd07882 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:16.242467 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7c4be83c-fd1a-4ab1-88df-bc72bcd07882 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:16.243474 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7c4be83c-fd1a-4ab1-88df-bc72bcd07882 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:16.244476 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7c4be83c-fd1a-4ab1-88df-bc72bcd07882 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:16.245343 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7c4be83c-fd1a-4ab1-88df-bc72bcd07882 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:16.245986 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7c4be83c-fd1a-4ab1-88df-bc72bcd07882 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:16.246415 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7c4be83c-fd1a-4ab1-88df-bc72bcd07882 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:16.425861 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-2ca480e0-e6e4-4aea-af3c-c5fc8567ed21 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:16.437667 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-2ca480e0-e6e4-4aea-af3c-c5fc8567ed21 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5" status: 200 len: 1367 microversion: 2.1 time: 0.253288 Aug 19 21:17:16.438591 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 377/825] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:17:16 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:17:16.462892 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-7c4be83c-fd1a-4ab1-88df-bc72bcd07882 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:16.471713 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-7c4be83c-fd1a-4ab1-88df-bc72bcd07882 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:16.473509 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-7c4be83c-fd1a-4ab1-88df-bc72bcd07882 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:16.474928 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-7c4be83c-fd1a-4ab1-88df-bc72bcd07882 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1721 microversion: 2.20 time: 0.245675 Aug 19 21:17:16.475678 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 449/826] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:16 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1721 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:16.538353 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-fccbd12c-2d62-439c-9981-bd4d935c338a req-04c5a483-8644-4c7d-b0c1-2c0974108df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5", "name": "network-vif-plugged", "status": "completed", "tag": "6ee9f12c-0d63-4bb1-9c4a-9f1b917fc468"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:17:16.549699 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-fccbd12c-2d62-439c-9981-bd4d935c338a req-04c5a483-8644-4c7d-b0c1-2c0974108df7 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:16.550222 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-fccbd12c-2d62-439c-9981-bd4d935c338a req-04c5a483-8644-4c7d-b0c1-2c0974108df7 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:16.550652 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-fccbd12c-2d62-439c-9981-bd4d935c338a req-04c5a483-8644-4c7d-b0c1-2c0974108df7 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:16.563083 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-fccbd12c-2d62-439c-9981-bd4d935c338a req-04c5a483-8644-4c7d-b0c1-2c0974108df7 service nova] Creating event network-vif-plugged:6ee9f12c-0d63-4bb1-9c4a-9f1b917fc468 for instance c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 on hv-cinder-85220 Aug 19 21:17:16.569485 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-fccbd12c-2d62-439c-9981-bd4d935c338a req-04c5a483-8644-4c7d-b0c1-2c0974108df7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034705 Aug 19 21:17:16.570655 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 378/827] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:17:17.462532 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3ed6d3f5-6f47-49f9-9b16-67f0450908a5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:17.463507 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-3ed6d3f5-6f47-49f9-9b16-67f0450908a5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:17.470363 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3ed6d3f5-6f47-49f9-9b16-67f0450908a5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:17.470841 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3ed6d3f5-6f47-49f9-9b16-67f0450908a5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:17.471267 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3ed6d3f5-6f47-49f9-9b16-67f0450908a5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:17.471954 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3ed6d3f5-6f47-49f9-9b16-67f0450908a5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:17.472402 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3ed6d3f5-6f47-49f9-9b16-67f0450908a5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:17.472807 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3ed6d3f5-6f47-49f9-9b16-67f0450908a5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:17.498957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-9811fa53-ce05-4cd4-ba98-404be4fd7ae0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:17.499659 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-9811fa53-ce05-4cd4-ba98-404be4fd7ae0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:17.506473 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9811fa53-ce05-4cd4-ba98-404be4fd7ae0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:17.506957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9811fa53-ce05-4cd4-ba98-404be4fd7ae0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:17.507565 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9811fa53-ce05-4cd4-ba98-404be4fd7ae0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:17.508268 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9811fa53-ce05-4cd4-ba98-404be4fd7ae0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:17.508723 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9811fa53-ce05-4cd4-ba98-404be4fd7ae0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:17.509142 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9811fa53-ce05-4cd4-ba98-404be4fd7ae0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:17.675368 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3ed6d3f5-6f47-49f9-9b16-67f0450908a5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:17.684953 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-3ed6d3f5-6f47-49f9-9b16-67f0450908a5 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5" status: 200 len: 1367 microversion: 2.1 time: 0.226821 Aug 19 21:17:17.685541 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 450/828] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:17:17 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:17:17.707640 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9811fa53-ce05-4cd4-ba98-404be4fd7ae0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:17.717194 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9811fa53-ce05-4cd4-ba98-404be4fd7ae0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:17.718763 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9811fa53-ce05-4cd4-ba98-404be4fd7ae0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:17.719951 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-9811fa53-ce05-4cd4-ba98-404be4fd7ae0 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1721 microversion: 2.20 time: 0.225753 Aug 19 21:17:17.720519 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 379/829] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:17 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:17:18.706231 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-2b4a101c-a63c-4201-8774-c4d1bcd5adb4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:18.706896 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-2b4a101c-a63c-4201-8774-c4d1bcd5adb4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:18.714601 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2b4a101c-a63c-4201-8774-c4d1bcd5adb4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:18.715120 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2b4a101c-a63c-4201-8774-c4d1bcd5adb4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:18.715558 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2b4a101c-a63c-4201-8774-c4d1bcd5adb4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:18.716272 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2b4a101c-a63c-4201-8774-c4d1bcd5adb4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:18.716727 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2b4a101c-a63c-4201-8774-c4d1bcd5adb4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:18.717149 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2b4a101c-a63c-4201-8774-c4d1bcd5adb4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:18.745298 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-105d5afa-e179-4e89-9abf-1b7b244e96d4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:18.746301 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-105d5afa-e179-4e89-9abf-1b7b244e96d4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:18.754133 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-105d5afa-e179-4e89-9abf-1b7b244e96d4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:18.754843 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-105d5afa-e179-4e89-9abf-1b7b244e96d4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:18.755391 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-105d5afa-e179-4e89-9abf-1b7b244e96d4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:18.756274 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-105d5afa-e179-4e89-9abf-1b7b244e96d4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:18.756893 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-105d5afa-e179-4e89-9abf-1b7b244e96d4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:18.757418 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-105d5afa-e179-4e89-9abf-1b7b244e96d4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:18.924354 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-2b4a101c-a63c-4201-8774-c4d1bcd5adb4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:18.932710 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-2b4a101c-a63c-4201-8774-c4d1bcd5adb4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5" status: 200 len: 1556 microversion: 2.1 time: 0.230506 Aug 19 21:17:18.933283 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 451/830] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:17:18 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 => generated 1556 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:17:18.950790 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=2 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:18.952885 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-105d5afa-e179-4e89-9abf-1b7b244e96d4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:18.955802 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-2c4a324e-f6c6-4fe3-bf38-d5b1c708e498 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:18.956399 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-2c4a324e-f6c6-4fe3-bf38-d5b1c708e498 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:18.961292 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-105d5afa-e179-4e89-9abf-1b7b244e96d4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:18.963611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2c4a324e-f6c6-4fe3-bf38-d5b1c708e498 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:18.963739 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-105d5afa-e179-4e89-9abf-1b7b244e96d4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:18.964221 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2c4a324e-f6c6-4fe3-bf38-d5b1c708e498 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:18.964733 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2c4a324e-f6c6-4fe3-bf38-d5b1c708e498 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:18.964863 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-105d5afa-e179-4e89-9abf-1b7b244e96d4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1721 microversion: 2.20 time: 0.224524 Aug 19 21:17:18.965350 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 380/831] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:18 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:17:18.965638 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2c4a324e-f6c6-4fe3-bf38-d5b1c708e498 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:18.966188 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2c4a324e-f6c6-4fe3-bf38-d5b1c708e498 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:18.966688 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2c4a324e-f6c6-4fe3-bf38-d5b1c708e498 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:18.967136 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=6 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:19.045911 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-2c4a324e-f6c6-4fe3-bf38-d5b1c708e498 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096318 Aug 19 21:17:19.046500 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 452/832] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Aug 19 21:17:18 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:17:19.989117 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-4a45d287-5bd7-4310-a633-3a8ea7a0faed tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:19.989829 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-4a45d287-5bd7-4310-a633-3a8ea7a0faed tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:19.991879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=6 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:19.998969 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4a45d287-5bd7-4310-a633-3a8ea7a0faed tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:19.999543 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4a45d287-5bd7-4310-a633-3a8ea7a0faed tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:20.000066 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4a45d287-5bd7-4310-a633-3a8ea7a0faed tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:20.000923 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4a45d287-5bd7-4310-a633-3a8ea7a0faed tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:20.001471 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4a45d287-5bd7-4310-a633-3a8ea7a0faed tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:20.002034 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4a45d287-5bd7-4310-a633-3a8ea7a0faed tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:20.050068 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-4a57a8cd-ea0f-43ba-a5a8-57a4b23edb41 req-e92e26d3-4399-4677-9537-ccd0b4a7b0f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5", "tag": "6ee9f12c-0d63-4bb1-9c4a-9f1b917fc468"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:17:20.062025 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-4a57a8cd-ea0f-43ba-a5a8-57a4b23edb41 req-e92e26d3-4399-4677-9537-ccd0b4a7b0f5 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:20.062517 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-4a57a8cd-ea0f-43ba-a5a8-57a4b23edb41 req-e92e26d3-4399-4677-9537-ccd0b4a7b0f5 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:20.062953 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-4a57a8cd-ea0f-43ba-a5a8-57a4b23edb41 req-e92e26d3-4399-4677-9537-ccd0b4a7b0f5 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:20.076217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-4a57a8cd-ea0f-43ba-a5a8-57a4b23edb41 req-e92e26d3-4399-4677-9537-ccd0b4a7b0f5 service nova] Creating event network-changed:6ee9f12c-0d63-4bb1-9c4a-9f1b917fc468 for instance c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 on hv-cinder-85220 Aug 19 21:17:20.081570 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-4a57a8cd-ea0f-43ba-a5a8-57a4b23edb41 req-e92e26d3-4399-4677-9537-ccd0b4a7b0f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035571 Aug 19 21:17:20.082673 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 453/833] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:17:20.163382 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-4a45d287-5bd7-4310-a633-3a8ea7a0faed tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:20.175110 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-4a45d287-5bd7-4310-a633-3a8ea7a0faed tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:20.177220 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-4a45d287-5bd7-4310-a633-3a8ea7a0faed tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:20.178455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-4a45d287-5bd7-4310-a633-3a8ea7a0faed tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1721 microversion: 2.20 time: 0.193577 Aug 19 21:17:20.179026 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 381/834] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:19 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:21.205018 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-bbb6cc50-0eda-47fb-8bfa-fb7ffeacb1a8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:21.205726 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-bbb6cc50-0eda-47fb-8bfa-fb7ffeacb1a8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:21.213259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bbb6cc50-0eda-47fb-8bfa-fb7ffeacb1a8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:21.213797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bbb6cc50-0eda-47fb-8bfa-fb7ffeacb1a8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:21.214461 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bbb6cc50-0eda-47fb-8bfa-fb7ffeacb1a8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:21.215253 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bbb6cc50-0eda-47fb-8bfa-fb7ffeacb1a8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:21.215713 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bbb6cc50-0eda-47fb-8bfa-fb7ffeacb1a8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:21.216172 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-bbb6cc50-0eda-47fb-8bfa-fb7ffeacb1a8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:21.219547 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:21.362378 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-bbb6cc50-0eda-47fb-8bfa-fb7ffeacb1a8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:21.371487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-bbb6cc50-0eda-47fb-8bfa-fb7ffeacb1a8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:21.373282 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-bbb6cc50-0eda-47fb-8bfa-fb7ffeacb1a8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:21.374497 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-bbb6cc50-0eda-47fb-8bfa-fb7ffeacb1a8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1721 microversion: 2.20 time: 0.174675 Aug 19 21:17:21.375054 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 454/835] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:21 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:22.398271 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-5c3e04ea-6300-4d82-a822-4f85433abf78 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:22.398833 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-5c3e04ea-6300-4d82-a822-4f85433abf78 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:22.405655 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5c3e04ea-6300-4d82-a822-4f85433abf78 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:22.406314 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5c3e04ea-6300-4d82-a822-4f85433abf78 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:22.406747 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5c3e04ea-6300-4d82-a822-4f85433abf78 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:22.407452 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5c3e04ea-6300-4d82-a822-4f85433abf78 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:22.407906 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5c3e04ea-6300-4d82-a822-4f85433abf78 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:22.408325 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5c3e04ea-6300-4d82-a822-4f85433abf78 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:22.550152 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-5c3e04ea-6300-4d82-a822-4f85433abf78 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:22.559405 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-5c3e04ea-6300-4d82-a822-4f85433abf78 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:22.560921 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-5c3e04ea-6300-4d82-a822-4f85433abf78 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:22.562124 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-5c3e04ea-6300-4d82-a822-4f85433abf78 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1721 microversion: 2.20 time: 0.167949 Aug 19 21:17:22.562693 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 382/836] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:22 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:23.585331 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8a254b04-fc70-4e62-92a1-0c6a6939a9ae tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:23.585994 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8a254b04-fc70-4e62-92a1-0c6a6939a9ae tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:23.593537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8a254b04-fc70-4e62-92a1-0c6a6939a9ae tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:23.594048 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8a254b04-fc70-4e62-92a1-0c6a6939a9ae tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:23.594496 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8a254b04-fc70-4e62-92a1-0c6a6939a9ae tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:23.595168 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8a254b04-fc70-4e62-92a1-0c6a6939a9ae tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:23.595619 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8a254b04-fc70-4e62-92a1-0c6a6939a9ae tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:23.596036 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8a254b04-fc70-4e62-92a1-0c6a6939a9ae tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:23.737522 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8a254b04-fc70-4e62-92a1-0c6a6939a9ae tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:23.746846 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8a254b04-fc70-4e62-92a1-0c6a6939a9ae tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:23.748369 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8a254b04-fc70-4e62-92a1-0c6a6939a9ae tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:23.749550 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8a254b04-fc70-4e62-92a1-0c6a6939a9ae tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1721 microversion: 2.20 time: 0.168104 Aug 19 21:17:23.750150 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 455/837] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:23 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:24.772640 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-29cbb308-6ef5-4de7-8a3b-454b7b1aba7f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:24.773245 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-29cbb308-6ef5-4de7-8a3b-454b7b1aba7f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:24.780543 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-29cbb308-6ef5-4de7-8a3b-454b7b1aba7f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:24.781026 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-29cbb308-6ef5-4de7-8a3b-454b7b1aba7f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:24.781459 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-29cbb308-6ef5-4de7-8a3b-454b7b1aba7f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:24.782188 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-29cbb308-6ef5-4de7-8a3b-454b7b1aba7f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:24.782639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-29cbb308-6ef5-4de7-8a3b-454b7b1aba7f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:24.783101 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-29cbb308-6ef5-4de7-8a3b-454b7b1aba7f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:24.916700 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-29cbb308-6ef5-4de7-8a3b-454b7b1aba7f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:24.924816 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-29cbb308-6ef5-4de7-8a3b-454b7b1aba7f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:24.926432 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-29cbb308-6ef5-4de7-8a3b-454b7b1aba7f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:24.927586 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-29cbb308-6ef5-4de7-8a3b-454b7b1aba7f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1721 microversion: 2.20 time: 0.158894 Aug 19 21:17:24.928141 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 383/838] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:24 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:17:25.951706 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-9ec27cbf-5095-4dce-bc07-02a7a2ace555 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:25.952249 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-9ec27cbf-5095-4dce-bc07-02a7a2ace555 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:25.958710 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9ec27cbf-5095-4dce-bc07-02a7a2ace555 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:25.959189 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9ec27cbf-5095-4dce-bc07-02a7a2ace555 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:25.959621 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9ec27cbf-5095-4dce-bc07-02a7a2ace555 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:25.960305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9ec27cbf-5095-4dce-bc07-02a7a2ace555 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:25.960760 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9ec27cbf-5095-4dce-bc07-02a7a2ace555 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:25.961181 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9ec27cbf-5095-4dce-bc07-02a7a2ace555 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:26.097135 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-9ec27cbf-5095-4dce-bc07-02a7a2ace555 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:26.105948 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-9ec27cbf-5095-4dce-bc07-02a7a2ace555 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:26.107494 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-9ec27cbf-5095-4dce-bc07-02a7a2ace555 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:26.108643 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-9ec27cbf-5095-4dce-bc07-02a7a2ace555 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1721 microversion: 2.20 time: 0.161632 Aug 19 21:17:26.109190 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 456/839] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:25 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:27.132516 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-f54b0c63-1a39-4267-a4d7-6528e89cf183 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:27.133120 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-f54b0c63-1a39-4267-a4d7-6528e89cf183 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:27.140199 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f54b0c63-1a39-4267-a4d7-6528e89cf183 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:27.140664 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f54b0c63-1a39-4267-a4d7-6528e89cf183 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:27.141101 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f54b0c63-1a39-4267-a4d7-6528e89cf183 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:27.141812 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f54b0c63-1a39-4267-a4d7-6528e89cf183 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:27.142269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f54b0c63-1a39-4267-a4d7-6528e89cf183 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:27.142684 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f54b0c63-1a39-4267-a4d7-6528e89cf183 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:27.282181 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-f54b0c63-1a39-4267-a4d7-6528e89cf183 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:27.290360 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-f54b0c63-1a39-4267-a4d7-6528e89cf183 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:27.291855 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-f54b0c63-1a39-4267-a4d7-6528e89cf183 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:27.293001 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-f54b0c63-1a39-4267-a4d7-6528e89cf183 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1721 microversion: 2.20 time: 0.164434 Aug 19 21:17:27.293554 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 384/840] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:27 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:28.316791 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-25e435ba-a9af-4a2c-a332-b74b6d840166 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:28.317392 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-25e435ba-a9af-4a2c-a332-b74b6d840166 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:28.324569 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-25e435ba-a9af-4a2c-a332-b74b6d840166 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:28.325093 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-25e435ba-a9af-4a2c-a332-b74b6d840166 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:28.325535 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-25e435ba-a9af-4a2c-a332-b74b6d840166 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:28.326272 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-25e435ba-a9af-4a2c-a332-b74b6d840166 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:28.326728 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-25e435ba-a9af-4a2c-a332-b74b6d840166 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:28.327154 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-25e435ba-a9af-4a2c-a332-b74b6d840166 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:28.619463 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-25e435ba-a9af-4a2c-a332-b74b6d840166 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:28.629789 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-25e435ba-a9af-4a2c-a332-b74b6d840166 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:28.631319 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-25e435ba-a9af-4a2c-a332-b74b6d840166 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:28.632546 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-25e435ba-a9af-4a2c-a332-b74b6d840166 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1721 microversion: 2.20 time: 0.319808 Aug 19 21:17:28.633112 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 457/841] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:28 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1721 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:29.657435 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-f65aa611-d0b9-4de5-8586-6f9047a2fd7c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:29.658057 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-f65aa611-d0b9-4de5-8586-6f9047a2fd7c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:29.664860 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f65aa611-d0b9-4de5-8586-6f9047a2fd7c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:29.666148 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f65aa611-d0b9-4de5-8586-6f9047a2fd7c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:29.666765 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f65aa611-d0b9-4de5-8586-6f9047a2fd7c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:29.667482 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f65aa611-d0b9-4de5-8586-6f9047a2fd7c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:29.667942 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f65aa611-d0b9-4de5-8586-6f9047a2fd7c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:29.668358 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f65aa611-d0b9-4de5-8586-6f9047a2fd7c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:29.816495 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-f65aa611-d0b9-4de5-8586-6f9047a2fd7c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:29.819210 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:29.827709 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-f65aa611-d0b9-4de5-8586-6f9047a2fd7c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:29.829232 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-f65aa611-d0b9-4de5-8586-6f9047a2fd7c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:29.830468 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-f65aa611-d0b9-4de5-8586-6f9047a2fd7c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1721 microversion: 2.20 time: 0.177259 Aug 19 21:17:29.831044 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 385/842] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:29 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:30.854165 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-716c282c-155f-4ba5-b289-f871342ecc44 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:30.854813 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-716c282c-155f-4ba5-b289-f871342ecc44 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:30.857299 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:30.862563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-716c282c-155f-4ba5-b289-f871342ecc44 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:30.863055 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-716c282c-155f-4ba5-b289-f871342ecc44 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:30.863490 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-716c282c-155f-4ba5-b289-f871342ecc44 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:30.864190 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-716c282c-155f-4ba5-b289-f871342ecc44 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:30.864645 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-716c282c-155f-4ba5-b289-f871342ecc44 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:30.865069 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-716c282c-155f-4ba5-b289-f871342ecc44 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:31.006281 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-716c282c-155f-4ba5-b289-f871342ecc44 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:31.016101 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-716c282c-155f-4ba5-b289-f871342ecc44 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:31.017606 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-716c282c-155f-4ba5-b289-f871342ecc44 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:31.018809 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-716c282c-155f-4ba5-b289-f871342ecc44 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1721 microversion: 2.20 time: 0.169011 Aug 19 21:17:31.019366 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 458/843] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:30 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:32.041752 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d8497ea0-a2d3-46b9-b8bf-f7636dd75b2a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:32.042379 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-d8497ea0-a2d3-46b9-b8bf-f7636dd75b2a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:32.044775 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:32.051239 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d8497ea0-a2d3-46b9-b8bf-f7636dd75b2a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:32.051730 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d8497ea0-a2d3-46b9-b8bf-f7636dd75b2a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:32.052163 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d8497ea0-a2d3-46b9-b8bf-f7636dd75b2a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:32.052849 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d8497ea0-a2d3-46b9-b8bf-f7636dd75b2a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:32.053304 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d8497ea0-a2d3-46b9-b8bf-f7636dd75b2a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:32.053747 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d8497ea0-a2d3-46b9-b8bf-f7636dd75b2a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:32.185822 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-d8497ea0-a2d3-46b9-b8bf-f7636dd75b2a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:32.194432 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-d8497ea0-a2d3-46b9-b8bf-f7636dd75b2a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:32.196504 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-d8497ea0-a2d3-46b9-b8bf-f7636dd75b2a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:32.197804 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-d8497ea0-a2d3-46b9-b8bf-f7636dd75b2a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1742 microversion: 2.20 time: 0.160211 Aug 19 21:17:32.198375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 386/844] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:32 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:33.221890 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0aaaa07b-fae0-4159-b06c-85400f0a3c68 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:33.222538 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0aaaa07b-fae0-4159-b06c-85400f0a3c68 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:33.229904 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0aaaa07b-fae0-4159-b06c-85400f0a3c68 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:33.230521 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0aaaa07b-fae0-4159-b06c-85400f0a3c68 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:33.230965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0aaaa07b-fae0-4159-b06c-85400f0a3c68 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:33.231666 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0aaaa07b-fae0-4159-b06c-85400f0a3c68 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:33.232140 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0aaaa07b-fae0-4159-b06c-85400f0a3c68 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:33.232565 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0aaaa07b-fae0-4159-b06c-85400f0a3c68 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:33.366787 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0aaaa07b-fae0-4159-b06c-85400f0a3c68 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:33.375726 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0aaaa07b-fae0-4159-b06c-85400f0a3c68 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:33.377230 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0aaaa07b-fae0-4159-b06c-85400f0a3c68 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:33.378410 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0aaaa07b-fae0-4159-b06c-85400f0a3c68 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1742 microversion: 2.20 time: 0.160553 Aug 19 21:17:33.378951 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 459/845] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:33 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:34.402501 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-5a00704b-958e-465e-b930-2a564378e3a4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:34.403092 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-5a00704b-958e-465e-b930-2a564378e3a4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:34.409785 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5a00704b-958e-465e-b930-2a564378e3a4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:34.410392 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5a00704b-958e-465e-b930-2a564378e3a4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:34.410685 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5a00704b-958e-465e-b930-2a564378e3a4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:34.411383 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5a00704b-958e-465e-b930-2a564378e3a4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:34.411832 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5a00704b-958e-465e-b930-2a564378e3a4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:34.412288 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5a00704b-958e-465e-b930-2a564378e3a4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:34.553968 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-5a00704b-958e-465e-b930-2a564378e3a4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:34.562777 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-5a00704b-958e-465e-b930-2a564378e3a4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:34.564383 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-5a00704b-958e-465e-b930-2a564378e3a4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:34.565571 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-5a00704b-958e-465e-b930-2a564378e3a4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1742 microversion: 2.20 time: 0.167322 Aug 19 21:17:34.566166 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 387/846] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:34 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1742 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:34.596126 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-f5e91726-055c-4ee8-8416-590477b5055d req-54547228-7e3b-4168-965d-7b580ce90d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5be0a3d-0419-4d69-83b2-22939e9c9bce", "name": "network-vif-plugged", "status": "completed", "tag": "eb7288c4-808b-4ef2-91d6-8f6c15db4227"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:17:34.608657 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-f5e91726-055c-4ee8-8416-590477b5055d req-54547228-7e3b-4168-965d-7b580ce90d86 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:34.609147 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-f5e91726-055c-4ee8-8416-590477b5055d req-54547228-7e3b-4168-965d-7b580ce90d86 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:34.609577 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-f5e91726-055c-4ee8-8416-590477b5055d req-54547228-7e3b-4168-965d-7b580ce90d86 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:34.622654 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-f5e91726-055c-4ee8-8416-590477b5055d req-54547228-7e3b-4168-965d-7b580ce90d86 service nova] Creating event network-vif-plugged:eb7288c4-808b-4ef2-91d6-8f6c15db4227 for instance e5be0a3d-0419-4d69-83b2-22939e9c9bce on hv-cinder-85220 Aug 19 21:17:34.628052 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-f5e91726-055c-4ee8-8416-590477b5055d req-54547228-7e3b-4168-965d-7b580ce90d86 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035713 Aug 19 21:17:34.628728 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 460/847] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:17:35.592397 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-b3d25c29-bda5-463b-a768-f5b661bfc0ae tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:35.593016 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-b3d25c29-bda5-463b-a768-f5b661bfc0ae tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:35.599612 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3d25c29-bda5-463b-a768-f5b661bfc0ae tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:35.600078 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3d25c29-bda5-463b-a768-f5b661bfc0ae tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:35.600505 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3d25c29-bda5-463b-a768-f5b661bfc0ae tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:35.601186 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3d25c29-bda5-463b-a768-f5b661bfc0ae tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:35.601633 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3d25c29-bda5-463b-a768-f5b661bfc0ae tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:35.602081 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3d25c29-bda5-463b-a768-f5b661bfc0ae tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:35.736231 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b3d25c29-bda5-463b-a768-f5b661bfc0ae tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:35.744319 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b3d25c29-bda5-463b-a768-f5b661bfc0ae tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:35.745835 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b3d25c29-bda5-463b-a768-f5b661bfc0ae tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:35.746987 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-b3d25c29-bda5-463b-a768-f5b661bfc0ae tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1742 microversion: 2.20 time: 0.158561 Aug 19 21:17:35.747548 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 388/848] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:35 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:36.772013 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-7f5f559b-cf1b-479f-9fd9-022d6367a868 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:36.773153 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-7f5f559b-cf1b-479f-9fd9-022d6367a868 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:36.783057 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7f5f559b-cf1b-479f-9fd9-022d6367a868 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:36.783596 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7f5f559b-cf1b-479f-9fd9-022d6367a868 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:36.784037 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7f5f559b-cf1b-479f-9fd9-022d6367a868 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:36.784749 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7f5f559b-cf1b-479f-9fd9-022d6367a868 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:36.785280 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7f5f559b-cf1b-479f-9fd9-022d6367a868 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:36.785890 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7f5f559b-cf1b-479f-9fd9-022d6367a868 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:36.943791 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-7f5f559b-cf1b-479f-9fd9-022d6367a868 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:36.954598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-7f5f559b-cf1b-479f-9fd9-022d6367a868 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:36.956134 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-7f5f559b-cf1b-479f-9fd9-022d6367a868 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:36.957325 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-7f5f559b-cf1b-479f-9fd9-022d6367a868 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1742 microversion: 2.20 time: 0.190349 Aug 19 21:17:36.957912 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 461/849] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:36 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1742 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:17:37.983670 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-a74c3661-5a69-4f67-a897-64322f8bf08a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:37.984216 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-a74c3661-5a69-4f67-a897-64322f8bf08a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:37.991259 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a74c3661-5a69-4f67-a897-64322f8bf08a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:37.991907 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a74c3661-5a69-4f67-a897-64322f8bf08a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:37.992338 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a74c3661-5a69-4f67-a897-64322f8bf08a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:37.993173 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a74c3661-5a69-4f67-a897-64322f8bf08a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:37.993731 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a74c3661-5a69-4f67-a897-64322f8bf08a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:37.994351 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a74c3661-5a69-4f67-a897-64322f8bf08a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:38.148828 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-a74c3661-5a69-4f67-a897-64322f8bf08a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:38.157551 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-a74c3661-5a69-4f67-a897-64322f8bf08a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:38.159084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-a74c3661-5a69-4f67-a897-64322f8bf08a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:38.160459 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-a74c3661-5a69-4f67-a897-64322f8bf08a tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1737 microversion: 2.20 time: 0.183637 Aug 19 21:17:38.161186 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 389/850] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:37 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:39.186033 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-88d69b88-5647-454d-932f-904541ad152c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:39.187479 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-88d69b88-5647-454d-932f-904541ad152c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:39.194847 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-88d69b88-5647-454d-932f-904541ad152c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:39.195432 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-88d69b88-5647-454d-932f-904541ad152c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:39.195970 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-88d69b88-5647-454d-932f-904541ad152c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:39.196785 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-88d69b88-5647-454d-932f-904541ad152c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:39.198146 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-88d69b88-5647-454d-932f-904541ad152c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:39.198800 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-88d69b88-5647-454d-932f-904541ad152c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:39.365836 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-88d69b88-5647-454d-932f-904541ad152c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:39.375222 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-88d69b88-5647-454d-932f-904541ad152c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:39.377793 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-88d69b88-5647-454d-932f-904541ad152c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:39.379016 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-88d69b88-5647-454d-932f-904541ad152c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1737 microversion: 2.20 time: 0.198361 Aug 19 21:17:39.379875 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 462/851] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:39 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:40.404688 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-129ac1b8-8f7a-4484-aa8b-5c747bab2a3e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:40.406083 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-129ac1b8-8f7a-4484-aa8b-5c747bab2a3e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:40.413239 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-129ac1b8-8f7a-4484-aa8b-5c747bab2a3e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:40.414069 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-129ac1b8-8f7a-4484-aa8b-5c747bab2a3e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:40.414809 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-129ac1b8-8f7a-4484-aa8b-5c747bab2a3e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:40.416223 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-129ac1b8-8f7a-4484-aa8b-5c747bab2a3e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:40.416883 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-129ac1b8-8f7a-4484-aa8b-5c747bab2a3e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:40.417516 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-129ac1b8-8f7a-4484-aa8b-5c747bab2a3e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:40.570267 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-129ac1b8-8f7a-4484-aa8b-5c747bab2a3e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:40.579105 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-129ac1b8-8f7a-4484-aa8b-5c747bab2a3e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:40.580631 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-129ac1b8-8f7a-4484-aa8b-5c747bab2a3e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:40.581823 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-129ac1b8-8f7a-4484-aa8b-5c747bab2a3e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1737 microversion: 2.20 time: 0.181853 Aug 19 21:17:40.597788 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 390/852] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:40 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1737 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:41.612752 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e9486d0b-15f9-492b-a16c-4f9814c84c44 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:41.613668 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-e9486d0b-15f9-492b-a16c-4f9814c84c44 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:41.621937 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e9486d0b-15f9-492b-a16c-4f9814c84c44 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:41.622517 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e9486d0b-15f9-492b-a16c-4f9814c84c44 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:41.623196 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e9486d0b-15f9-492b-a16c-4f9814c84c44 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:41.624229 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e9486d0b-15f9-492b-a16c-4f9814c84c44 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:41.625415 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e9486d0b-15f9-492b-a16c-4f9814c84c44 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:41.626007 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e9486d0b-15f9-492b-a16c-4f9814c84c44 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:41.780103 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e9486d0b-15f9-492b-a16c-4f9814c84c44 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:41.789196 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e9486d0b-15f9-492b-a16c-4f9814c84c44 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:41.790859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e9486d0b-15f9-492b-a16c-4f9814c84c44 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:41.792547 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e9486d0b-15f9-492b-a16c-4f9814c84c44 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1737 microversion: 2.20 time: 0.190659 Aug 19 21:17:41.793421 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 463/853] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:41 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:17:42.816151 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-02669a21-94f8-489d-833b-f4cf0c577b9b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:42.816762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-02669a21-94f8-489d-833b-f4cf0c577b9b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:42.823933 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-02669a21-94f8-489d-833b-f4cf0c577b9b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:42.824421 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-02669a21-94f8-489d-833b-f4cf0c577b9b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:42.824857 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-02669a21-94f8-489d-833b-f4cf0c577b9b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:42.825554 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-02669a21-94f8-489d-833b-f4cf0c577b9b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:42.826051 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-02669a21-94f8-489d-833b-f4cf0c577b9b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:42.826477 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-02669a21-94f8-489d-833b-f4cf0c577b9b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:42.977247 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-02669a21-94f8-489d-833b-f4cf0c577b9b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:42.988981 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-02669a21-94f8-489d-833b-f4cf0c577b9b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:42.990512 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-02669a21-94f8-489d-833b-f4cf0c577b9b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:42.991893 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-02669a21-94f8-489d-833b-f4cf0c577b9b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1737 microversion: 2.20 time: 0.179800 Aug 19 21:17:42.992440 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 391/854] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:42 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:17:44.017644 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3a6629bc-0a42-4a0c-af7b-fb3831202baa tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:44.018575 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-3a6629bc-0a42-4a0c-af7b-fb3831202baa tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:44.029884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3a6629bc-0a42-4a0c-af7b-fb3831202baa tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:44.029884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3a6629bc-0a42-4a0c-af7b-fb3831202baa tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:44.029884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3a6629bc-0a42-4a0c-af7b-fb3831202baa tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:44.029884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3a6629bc-0a42-4a0c-af7b-fb3831202baa tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:44.030566 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3a6629bc-0a42-4a0c-af7b-fb3831202baa tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:44.030566 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3a6629bc-0a42-4a0c-af7b-fb3831202baa tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:44.189093 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3a6629bc-0a42-4a0c-af7b-fb3831202baa tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:44.200185 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3a6629bc-0a42-4a0c-af7b-fb3831202baa tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:44.201906 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3a6629bc-0a42-4a0c-af7b-fb3831202baa tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:44.203559 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-3a6629bc-0a42-4a0c-af7b-fb3831202baa tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1737 microversion: 2.20 time: 0.190417 Aug 19 21:17:44.204601 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 464/855] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:44 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:45.227501 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-00ff9f78-a4ef-4de2-a6e2-a087087e7050 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:45.229157 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-00ff9f78-a4ef-4de2-a6e2-a087087e7050 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:45.237744 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-00ff9f78-a4ef-4de2-a6e2-a087087e7050 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:45.238361 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-00ff9f78-a4ef-4de2-a6e2-a087087e7050 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:45.238868 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-00ff9f78-a4ef-4de2-a6e2-a087087e7050 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:45.239648 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-00ff9f78-a4ef-4de2-a6e2-a087087e7050 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:45.240170 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-00ff9f78-a4ef-4de2-a6e2-a087087e7050 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:45.240659 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-00ff9f78-a4ef-4de2-a6e2-a087087e7050 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:45.387769 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-00ff9f78-a4ef-4de2-a6e2-a087087e7050 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:45.401953 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-00ff9f78-a4ef-4de2-a6e2-a087087e7050 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:45.403515 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-00ff9f78-a4ef-4de2-a6e2-a087087e7050 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:45.404806 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-00ff9f78-a4ef-4de2-a6e2-a087087e7050 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1737 microversion: 2.20 time: 0.181149 Aug 19 21:17:45.405717 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 392/856] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:45 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:46.429056 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-382c2490-ed12-46eb-ab7f-e008aef40e59 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:46.429662 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-382c2490-ed12-46eb-ab7f-e008aef40e59 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:46.436360 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-382c2490-ed12-46eb-ab7f-e008aef40e59 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:46.436853 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-382c2490-ed12-46eb-ab7f-e008aef40e59 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:46.437295 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-382c2490-ed12-46eb-ab7f-e008aef40e59 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:46.438243 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-382c2490-ed12-46eb-ab7f-e008aef40e59 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:46.438916 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-382c2490-ed12-46eb-ab7f-e008aef40e59 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:46.439346 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-382c2490-ed12-46eb-ab7f-e008aef40e59 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:46.578845 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-382c2490-ed12-46eb-ab7f-e008aef40e59 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:46.588576 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-382c2490-ed12-46eb-ab7f-e008aef40e59 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:46.590234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-382c2490-ed12-46eb-ab7f-e008aef40e59 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:46.591363 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-382c2490-ed12-46eb-ab7f-e008aef40e59 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1737 microversion: 2.20 time: 0.166583 Aug 19 21:17:46.591935 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 465/857] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:46 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:47.614649 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-8a01a27a-ed3a-4984-96e9-b804676343bb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:47.615263 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-8a01a27a-ed3a-4984-96e9-b804676343bb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:47.623318 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8a01a27a-ed3a-4984-96e9-b804676343bb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:47.623817 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8a01a27a-ed3a-4984-96e9-b804676343bb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:47.624252 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8a01a27a-ed3a-4984-96e9-b804676343bb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:47.624956 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8a01a27a-ed3a-4984-96e9-b804676343bb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:47.625396 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8a01a27a-ed3a-4984-96e9-b804676343bb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:47.626448 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8a01a27a-ed3a-4984-96e9-b804676343bb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:47.797404 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-8a01a27a-ed3a-4984-96e9-b804676343bb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:47.807837 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-8a01a27a-ed3a-4984-96e9-b804676343bb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:47.809409 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-8a01a27a-ed3a-4984-96e9-b804676343bb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:47.810677 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-8a01a27a-ed3a-4984-96e9-b804676343bb tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1719 microversion: 2.20 time: 0.199948 Aug 19 21:17:47.811252 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 393/858] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:47 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1719 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:48.835475 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-35c0dd3c-22cb-43ef-8d0f-0b7f304edc79 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:48.836657 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-35c0dd3c-22cb-43ef-8d0f-0b7f304edc79 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:48.843680 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-35c0dd3c-22cb-43ef-8d0f-0b7f304edc79 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:48.844238 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-35c0dd3c-22cb-43ef-8d0f-0b7f304edc79 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:48.844667 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-35c0dd3c-22cb-43ef-8d0f-0b7f304edc79 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:48.845367 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-35c0dd3c-22cb-43ef-8d0f-0b7f304edc79 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:48.845864 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-35c0dd3c-22cb-43ef-8d0f-0b7f304edc79 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:48.846283 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-35c0dd3c-22cb-43ef-8d0f-0b7f304edc79 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:48.977933 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-35c0dd3c-22cb-43ef-8d0f-0b7f304edc79 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:48.987062 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-35c0dd3c-22cb-43ef-8d0f-0b7f304edc79 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:48.988566 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-35c0dd3c-22cb-43ef-8d0f-0b7f304edc79 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:48.989724 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-35c0dd3c-22cb-43ef-8d0f-0b7f304edc79 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1719 microversion: 2.20 time: 0.158238 Aug 19 21:17:48.990301 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 466/859] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:48 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:50.013082 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-9d6c0575-d464-4b5d-bb5b-c3ffbf07e8b8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:50.014110 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-9d6c0575-d464-4b5d-bb5b-c3ffbf07e8b8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:50.020861 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9d6c0575-d464-4b5d-bb5b-c3ffbf07e8b8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:50.021352 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9d6c0575-d464-4b5d-bb5b-c3ffbf07e8b8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:50.021797 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9d6c0575-d464-4b5d-bb5b-c3ffbf07e8b8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:50.022499 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9d6c0575-d464-4b5d-bb5b-c3ffbf07e8b8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:50.022951 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9d6c0575-d464-4b5d-bb5b-c3ffbf07e8b8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:50.023370 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9d6c0575-d464-4b5d-bb5b-c3ffbf07e8b8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:50.428446 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a803a641-b179-43da-bdbc-c4718513dc8c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:50.428973 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-a803a641-b179-43da-bdbc-c4718513dc8c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:50.436125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a803a641-b179-43da-bdbc-c4718513dc8c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:50.436361 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9d6c0575-d464-4b5d-bb5b-c3ffbf07e8b8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:50.436623 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a803a641-b179-43da-bdbc-c4718513dc8c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:50.437063 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a803a641-b179-43da-bdbc-c4718513dc8c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:50.437792 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a803a641-b179-43da-bdbc-c4718513dc8c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:50.438245 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a803a641-b179-43da-bdbc-c4718513dc8c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:50.438672 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a803a641-b179-43da-bdbc-c4718513dc8c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:50.444556 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9d6c0575-d464-4b5d-bb5b-c3ffbf07e8b8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:50.446078 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9d6c0575-d464-4b5d-bb5b-c3ffbf07e8b8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:50.447855 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-9d6c0575-d464-4b5d-bb5b-c3ffbf07e8b8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1662 microversion: 2.20 time: 0.439204 Aug 19 21:17:50.448413 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 394/860] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:50 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1662 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:50.463567 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-a803a641-b179-43da-bdbc-c4718513dc8c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/ips" status: 200 len: 145 microversion: 2.1 time: 0.039091 Aug 19 21:17:50.464144 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 467/861] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Aug 19 21:17:50 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:17:50.470812 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-76b18c39-bda3-4466-9cf7-fe46e702be54 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8710fe64-3053-4168-a524-dcaad58f780e"}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:17:50.473196 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-76b18c39-bda3-4466-9cf7-fe46e702be54 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:50.480024 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-76b18c39-bda3-4466-9cf7-fe46e702be54 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:50.480498 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-76b18c39-bda3-4466-9cf7-fe46e702be54 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:50.480924 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-76b18c39-bda3-4466-9cf7-fe46e702be54 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:50.481608 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-76b18c39-bda3-4466-9cf7-fe46e702be54 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:50.482076 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-76b18c39-bda3-4466-9cf7-fe46e702be54 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:50.482689 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-76b18c39-bda3-4466-9cf7-fe46e702be54 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:50.649563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-c921947f-5cb3-4c88-a963-a0df29589f74 req-1ff3335e-f5a1-4b9e-86b9-3bfa5297faff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5be0a3d-0419-4d69-83b2-22939e9c9bce", "name": "network-vif-unplugged", "status": "completed", "tag": "eb7288c4-808b-4ef2-91d6-8f6c15db4227"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:17:50.661095 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-c921947f-5cb3-4c88-a963-a0df29589f74 req-1ff3335e-f5a1-4b9e-86b9-3bfa5297faff service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:50.661738 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-c921947f-5cb3-4c88-a963-a0df29589f74 req-1ff3335e-f5a1-4b9e-86b9-3bfa5297faff service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:50.662158 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-c921947f-5cb3-4c88-a963-a0df29589f74 req-1ff3335e-f5a1-4b9e-86b9-3bfa5297faff service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:50.675964 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.compute.server_external_events [req-c921947f-5cb3-4c88-a963-a0df29589f74 req-1ff3335e-f5a1-4b9e-86b9-3bfa5297faff service nova] Unable to find a host for instance e5be0a3d-0419-4d69-83b2-22939e9c9bce. Dropping event network-vif-unplugged {{(pid=120877) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 19 21:17:50.677454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-c921947f-5cb3-4c88-a963-a0df29589f74 req-1ff3335e-f5a1-4b9e-86b9-3bfa5297faff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031460 Aug 19 21:17:50.685017 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 468/862] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 19 21:17:50.807930 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-76b18c39-bda3-4466-9cf7-fe46e702be54 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "POST /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.340842 Aug 19 21:17:50.808542 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 395/863] 10.222.0.16 () {62 vars in 1364 bytes} [Fri Aug 19 21:17:50 2022] POST /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce/os-volume_attachments => generated 188 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 21:17:50.931076 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-fad809e6-dc3e-45cb-bf85-93b4d9f46a84 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:50.931505 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-fad809e6-dc3e-45cb-bf85-93b4d9f46a84 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:50.937393 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fad809e6-dc3e-45cb-bf85-93b4d9f46a84 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:50.937909 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fad809e6-dc3e-45cb-bf85-93b4d9f46a84 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:50.938346 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fad809e6-dc3e-45cb-bf85-93b4d9f46a84 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:50.939030 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fad809e6-dc3e-45cb-bf85-93b4d9f46a84 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:50.939485 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fad809e6-dc3e-45cb-bf85-93b4d9f46a84 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:50.939907 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fad809e6-dc3e-45cb-bf85-93b4d9f46a84 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:51.175373 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:51.181884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-fad809e6-dc3e-45cb-bf85-93b4d9f46a84 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce/os-volume_attachments/8710fe64-3053-4168-a524-dcaad58f780e" status: 202 len: 0 microversion: 2.20 time: 0.254111 Aug 19 21:17:51.182539 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 469/864] 10.222.0.16 () {60 vars in 1457 bytes} [Fri Aug 19 21:17:50 2022] DELETE /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce/os-volume_attachments/8710fe64-3053-4168-a524-dcaad58f780e => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 19 21:17:51.245380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-bb3eedbd-9514-4d7a-9a51-9ad900325719 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:17:51.246113 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-bb3eedbd-9514-4d7a-9a51-9ad900325719 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:51.252790 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-bb3eedbd-9514-4d7a-9a51-9ad900325719 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:51.253268 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-bb3eedbd-9514-4d7a-9a51-9ad900325719 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:51.253698 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-bb3eedbd-9514-4d7a-9a51-9ad900325719 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:51.254414 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-bb3eedbd-9514-4d7a-9a51-9ad900325719 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:51.254864 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-bb3eedbd-9514-4d7a-9a51-9ad900325719 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:51.255282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-bb3eedbd-9514-4d7a-9a51-9ad900325719 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:51.286390 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-bb3eedbd-9514-4d7a-9a51-9ad900325719 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120876) unshelve /opt/stack/nova/nova/compute/api.py:4584}} Aug 19 21:17:51.357375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bb3eedbd-9514-4d7a-9a51-9ad900325719 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [e5e8f374-fe5f-4859-8fe5-41a593e36e98] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 19 21:17:51.851598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-d73d314d-891f-430e-b4f3-6a8d58aeff60 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbfb5178-8b5d-447b-922c-510c79b21c2d"}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:17:51.854911 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-d73d314d-891f-430e-b4f3-6a8d58aeff60 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:51.862750 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d73d314d-891f-430e-b4f3-6a8d58aeff60 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:51.863229 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d73d314d-891f-430e-b4f3-6a8d58aeff60 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:51.863656 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d73d314d-891f-430e-b4f3-6a8d58aeff60 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:51.864349 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d73d314d-891f-430e-b4f3-6a8d58aeff60 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:51.864815 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d73d314d-891f-430e-b4f3-6a8d58aeff60 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:51.865215 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d73d314d-891f-430e-b4f3-6a8d58aeff60 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:52.114756 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-d73d314d-891f-430e-b4f3-6a8d58aeff60 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "POST /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267248 Aug 19 21:17:52.115439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 470/865] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Aug 19 21:17:51 2022] POST /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:17:52.365008 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO oslo.messaging._drivers.impl_rabbit [None req-bb3eedbd-9514-4d7a-9a51-9ad900325719 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [e5e8f374-fe5f-4859-8fe5-41a593e36e98] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60950. Aug 19 21:17:52.368154 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-bb3eedbd-9514-4d7a-9a51-9ad900325719 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "POST /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce/action" status: 202 len: 0 microversion: 2.20 time: 1.127347 Aug 19 21:17:52.368898 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 396/866] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Aug 19 21:17:51 2022] POST /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce/action => generated 0 bytes in 1129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 19 21:17:52.379124 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ff9ff885-9094-4da6-8d84-f9d55b8d0208 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:52.379861 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ff9ff885-9094-4da6-8d84-f9d55b8d0208 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:52.387070 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ff9ff885-9094-4da6-8d84-f9d55b8d0208 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:52.388104 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ff9ff885-9094-4da6-8d84-f9d55b8d0208 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:52.389134 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ff9ff885-9094-4da6-8d84-f9d55b8d0208 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:52.389964 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ff9ff885-9094-4da6-8d84-f9d55b8d0208 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:52.390500 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ff9ff885-9094-4da6-8d84-f9d55b8d0208 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:52.390977 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ff9ff885-9094-4da6-8d84-f9d55b8d0208 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:52.621191 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ff9ff885-9094-4da6-8d84-f9d55b8d0208 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:52.629796 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ff9ff885-9094-4da6-8d84-f9d55b8d0208 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:52.631327 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ff9ff885-9094-4da6-8d84-f9d55b8d0208 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:52.632505 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ff9ff885-9094-4da6-8d84-f9d55b8d0208 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1670 microversion: 2.20 time: 0.258511 Aug 19 21:17:52.633059 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 471/867] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:52 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1670 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:53.657836 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-b15670b1-7c77-472f-9f3e-da264bbaa25c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:53.658677 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-b15670b1-7c77-472f-9f3e-da264bbaa25c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:53.664938 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b15670b1-7c77-472f-9f3e-da264bbaa25c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:53.667062 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b15670b1-7c77-472f-9f3e-da264bbaa25c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:53.667546 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b15670b1-7c77-472f-9f3e-da264bbaa25c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:53.668290 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b15670b1-7c77-472f-9f3e-da264bbaa25c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:53.668752 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b15670b1-7c77-472f-9f3e-da264bbaa25c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:53.669167 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b15670b1-7c77-472f-9f3e-da264bbaa25c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:53.830697 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b15670b1-7c77-472f-9f3e-da264bbaa25c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:53.847607 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b15670b1-7c77-472f-9f3e-da264bbaa25c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:53.850226 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b15670b1-7c77-472f-9f3e-da264bbaa25c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:53.851476 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-b15670b1-7c77-472f-9f3e-da264bbaa25c tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1728 microversion: 2.20 time: 0.198345 Aug 19 21:17:53.852047 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 397/868] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:53 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1728 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:54.877349 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-359def0a-74ed-4417-9aad-70cdb9025a0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:54.878384 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-359def0a-74ed-4417-9aad-70cdb9025a0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:54.886373 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-359def0a-74ed-4417-9aad-70cdb9025a0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:54.886876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-359def0a-74ed-4417-9aad-70cdb9025a0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:54.887313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-359def0a-74ed-4417-9aad-70cdb9025a0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:54.888023 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-359def0a-74ed-4417-9aad-70cdb9025a0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:54.888479 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-359def0a-74ed-4417-9aad-70cdb9025a0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:54.889169 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-359def0a-74ed-4417-9aad-70cdb9025a0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:55.050322 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-359def0a-74ed-4417-9aad-70cdb9025a0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:55.060280 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-359def0a-74ed-4417-9aad-70cdb9025a0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:55.062151 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-359def0a-74ed-4417-9aad-70cdb9025a0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:55.064208 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-359def0a-74ed-4417-9aad-70cdb9025a0e tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1728 microversion: 2.20 time: 0.190932 Aug 19 21:17:55.064910 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 472/869] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:54 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1728 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:56.089369 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-6c2e1076-46ff-410e-ab32-388c3020540b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:56.091156 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-6c2e1076-46ff-410e-ab32-388c3020540b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:56.097649 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6c2e1076-46ff-410e-ab32-388c3020540b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:56.098322 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6c2e1076-46ff-410e-ab32-388c3020540b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:56.098859 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6c2e1076-46ff-410e-ab32-388c3020540b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:56.099670 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6c2e1076-46ff-410e-ab32-388c3020540b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:56.100225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6c2e1076-46ff-410e-ab32-388c3020540b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:56.100895 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6c2e1076-46ff-410e-ab32-388c3020540b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:56.247825 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-6c2e1076-46ff-410e-ab32-388c3020540b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:56.250858 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:17:56.261110 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-6c2e1076-46ff-410e-ab32-388c3020540b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:56.262688 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-6c2e1076-46ff-410e-ab32-388c3020540b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:56.264180 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-6c2e1076-46ff-410e-ab32-388c3020540b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1728 microversion: 2.20 time: 0.179682 Aug 19 21:17:56.264748 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 398/870] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:56 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:57.286829 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-6cb7ef3c-c0a1-4f16-b376-29eca5905a86 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:57.287460 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-6cb7ef3c-c0a1-4f16-b376-29eca5905a86 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:57.295583 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6cb7ef3c-c0a1-4f16-b376-29eca5905a86 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:57.296529 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6cb7ef3c-c0a1-4f16-b376-29eca5905a86 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:57.297351 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6cb7ef3c-c0a1-4f16-b376-29eca5905a86 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:57.298563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6cb7ef3c-c0a1-4f16-b376-29eca5905a86 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:57.299378 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6cb7ef3c-c0a1-4f16-b376-29eca5905a86 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:57.300121 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6cb7ef3c-c0a1-4f16-b376-29eca5905a86 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:57.483958 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-6cb7ef3c-c0a1-4f16-b376-29eca5905a86 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:57.494601 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-6cb7ef3c-c0a1-4f16-b376-29eca5905a86 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:57.496365 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-6cb7ef3c-c0a1-4f16-b376-29eca5905a86 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:57.498028 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-6cb7ef3c-c0a1-4f16-b376-29eca5905a86 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1728 microversion: 2.20 time: 0.215116 Aug 19 21:17:57.498746 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 473/871] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:57 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1728 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:58.528168 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-68aa9797-9249-4e6e-8a4d-5a953dcddbb7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:58.529156 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-68aa9797-9249-4e6e-8a4d-5a953dcddbb7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:58.538033 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-68aa9797-9249-4e6e-8a4d-5a953dcddbb7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:58.538662 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-68aa9797-9249-4e6e-8a4d-5a953dcddbb7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:58.539102 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-68aa9797-9249-4e6e-8a4d-5a953dcddbb7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:58.539910 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-68aa9797-9249-4e6e-8a4d-5a953dcddbb7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:58.540872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-68aa9797-9249-4e6e-8a4d-5a953dcddbb7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:58.541458 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-68aa9797-9249-4e6e-8a4d-5a953dcddbb7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:58.698752 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-68aa9797-9249-4e6e-8a4d-5a953dcddbb7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:58.707499 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-68aa9797-9249-4e6e-8a4d-5a953dcddbb7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:58.709002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-68aa9797-9249-4e6e-8a4d-5a953dcddbb7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:58.710234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-68aa9797-9249-4e6e-8a4d-5a953dcddbb7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1728 microversion: 2.20 time: 0.187999 Aug 19 21:17:58.711129 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 399/872] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:58 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1728 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:17:59.735017 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c29ba42c-28f2-4578-8e74-19b1eac1f321 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:17:59.735623 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-c29ba42c-28f2-4578-8e74-19b1eac1f321 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:17:59.742065 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c29ba42c-28f2-4578-8e74-19b1eac1f321 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:59.742544 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c29ba42c-28f2-4578-8e74-19b1eac1f321 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:59.742979 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c29ba42c-28f2-4578-8e74-19b1eac1f321 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:59.744432 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c29ba42c-28f2-4578-8e74-19b1eac1f321 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:17:59.744980 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c29ba42c-28f2-4578-8e74-19b1eac1f321 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:17:59.745409 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c29ba42c-28f2-4578-8e74-19b1eac1f321 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:17:59.881318 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c29ba42c-28f2-4578-8e74-19b1eac1f321 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:59.891195 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c29ba42c-28f2-4578-8e74-19b1eac1f321 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:59.892706 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c29ba42c-28f2-4578-8e74-19b1eac1f321 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:17:59.893940 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-c29ba42c-28f2-4578-8e74-19b1eac1f321 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1728 microversion: 2.20 time: 0.162799 Aug 19 21:17:59.894508 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 474/873] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:17:59 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:18:00.919955 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-646495e3-f7ce-440c-9ffa-8cf1e3522193 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:00.920611 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-646495e3-f7ce-440c-9ffa-8cf1e3522193 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:00.926810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-646495e3-f7ce-440c-9ffa-8cf1e3522193 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:00.927299 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-646495e3-f7ce-440c-9ffa-8cf1e3522193 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:00.927733 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-646495e3-f7ce-440c-9ffa-8cf1e3522193 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:00.928431 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-646495e3-f7ce-440c-9ffa-8cf1e3522193 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:00.928880 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-646495e3-f7ce-440c-9ffa-8cf1e3522193 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:00.929301 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-646495e3-f7ce-440c-9ffa-8cf1e3522193 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:01.068569 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-646495e3-f7ce-440c-9ffa-8cf1e3522193 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:01.080990 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-646495e3-f7ce-440c-9ffa-8cf1e3522193 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:01.083115 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-646495e3-f7ce-440c-9ffa-8cf1e3522193 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:01.084095 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-646495e3-f7ce-440c-9ffa-8cf1e3522193 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1728 microversion: 2.20 time: 0.168630 Aug 19 21:18:01.086311 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 400/874] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:18:00 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:18:02.108029 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-16c276c6-36bf-4ee1-a743-d1ae45c4e474 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:02.108663 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-16c276c6-36bf-4ee1-a743-d1ae45c4e474 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:02.110616 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=34 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:18:02.115806 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-16c276c6-36bf-4ee1-a743-d1ae45c4e474 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:02.116283 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-16c276c6-36bf-4ee1-a743-d1ae45c4e474 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:02.116714 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-16c276c6-36bf-4ee1-a743-d1ae45c4e474 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:02.117397 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-16c276c6-36bf-4ee1-a743-d1ae45c4e474 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:02.117875 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-16c276c6-36bf-4ee1-a743-d1ae45c4e474 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:02.118294 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-16c276c6-36bf-4ee1-a743-d1ae45c4e474 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:02.266271 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-16c276c6-36bf-4ee1-a743-d1ae45c4e474 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:02.275556 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-16c276c6-36bf-4ee1-a743-d1ae45c4e474 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:02.277074 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-16c276c6-36bf-4ee1-a743-d1ae45c4e474 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:02.278297 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-16c276c6-36bf-4ee1-a743-d1ae45c4e474 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1728 microversion: 2.20 time: 0.175563 Aug 19 21:18:02.279056 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 475/875] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:18:02 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:18:03.302112 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-36c140f4-3f60-4228-91aa-71bd7a15a6b3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:03.302696 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-36c140f4-3f60-4228-91aa-71bd7a15a6b3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:03.305150 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:18:03.311355 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-36c140f4-3f60-4228-91aa-71bd7a15a6b3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:03.311836 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-36c140f4-3f60-4228-91aa-71bd7a15a6b3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:03.312374 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-36c140f4-3f60-4228-91aa-71bd7a15a6b3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:03.313060 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-36c140f4-3f60-4228-91aa-71bd7a15a6b3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:03.313704 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-36c140f4-3f60-4228-91aa-71bd7a15a6b3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:03.314150 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-36c140f4-3f60-4228-91aa-71bd7a15a6b3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:03.470878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-36c140f4-3f60-4228-91aa-71bd7a15a6b3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:03.483343 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-36c140f4-3f60-4228-91aa-71bd7a15a6b3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:03.484865 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-36c140f4-3f60-4228-91aa-71bd7a15a6b3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:03.486160 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-36c140f4-3f60-4228-91aa-71bd7a15a6b3 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1728 microversion: 2.20 time: 0.187935 Aug 19 21:18:03.486742 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 401/876] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:18:03 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1728 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:18:04.508431 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-71161e10-7306-4e33-9e36-05302da321c4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:04.509020 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-71161e10-7306-4e33-9e36-05302da321c4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:04.516356 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-71161e10-7306-4e33-9e36-05302da321c4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:04.516841 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-71161e10-7306-4e33-9e36-05302da321c4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:04.517276 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-71161e10-7306-4e33-9e36-05302da321c4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:04.518001 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-71161e10-7306-4e33-9e36-05302da321c4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:04.518450 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-71161e10-7306-4e33-9e36-05302da321c4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:04.518868 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-71161e10-7306-4e33-9e36-05302da321c4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:04.661495 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-71161e10-7306-4e33-9e36-05302da321c4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:04.672545 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-71161e10-7306-4e33-9e36-05302da321c4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:04.674101 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-71161e10-7306-4e33-9e36-05302da321c4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:04.675265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-71161e10-7306-4e33-9e36-05302da321c4 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1728 microversion: 2.20 time: 0.170741 Aug 19 21:18:04.675823 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 476/877] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:18:04 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:18:05.698866 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-dcfaecfe-ec73-490c-825c-1e8c4308acf8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:05.699552 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-dcfaecfe-ec73-490c-825c-1e8c4308acf8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:05.706014 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dcfaecfe-ec73-490c-825c-1e8c4308acf8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:05.706504 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dcfaecfe-ec73-490c-825c-1e8c4308acf8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:05.706937 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dcfaecfe-ec73-490c-825c-1e8c4308acf8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:05.707626 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dcfaecfe-ec73-490c-825c-1e8c4308acf8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:05.708078 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dcfaecfe-ec73-490c-825c-1e8c4308acf8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:05.708498 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-dcfaecfe-ec73-490c-825c-1e8c4308acf8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:05.843386 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-dcfaecfe-ec73-490c-825c-1e8c4308acf8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:05.851583 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-dcfaecfe-ec73-490c-825c-1e8c4308acf8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:05.853573 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-dcfaecfe-ec73-490c-825c-1e8c4308acf8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:05.854758 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-dcfaecfe-ec73-490c-825c-1e8c4308acf8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1728 microversion: 2.20 time: 0.160420 Aug 19 21:18:05.855318 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 402/878] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:18:05 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:18:06.879477 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-172f3c0e-f47d-4770-beaf-4942e5eb4693 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:06.880078 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-172f3c0e-f47d-4770-beaf-4942e5eb4693 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:06.887918 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-172f3c0e-f47d-4770-beaf-4942e5eb4693 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:06.888400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-172f3c0e-f47d-4770-beaf-4942e5eb4693 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:06.888832 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-172f3c0e-f47d-4770-beaf-4942e5eb4693 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:06.889788 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-172f3c0e-f47d-4770-beaf-4942e5eb4693 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:06.890257 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-172f3c0e-f47d-4770-beaf-4942e5eb4693 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:06.890682 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-172f3c0e-f47d-4770-beaf-4942e5eb4693 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:07.223319 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-172f3c0e-f47d-4770-beaf-4942e5eb4693 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:07.233875 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-172f3c0e-f47d-4770-beaf-4942e5eb4693 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:07.235683 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-172f3c0e-f47d-4770-beaf-4942e5eb4693 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:07.236864 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-172f3c0e-f47d-4770-beaf-4942e5eb4693 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1728 microversion: 2.20 time: 0.361379 Aug 19 21:18:07.237426 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 477/879] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:18:06 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1728 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:18:08.261197 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-b3c7357a-07c5-43e7-b8d8-5899c2906ed8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:08.261849 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-b3c7357a-07c5-43e7-b8d8-5899c2906ed8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:08.268684 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3c7357a-07c5-43e7-b8d8-5899c2906ed8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:08.269163 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3c7357a-07c5-43e7-b8d8-5899c2906ed8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:08.269592 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3c7357a-07c5-43e7-b8d8-5899c2906ed8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:08.270304 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3c7357a-07c5-43e7-b8d8-5899c2906ed8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:08.270753 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3c7357a-07c5-43e7-b8d8-5899c2906ed8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:08.271169 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3c7357a-07c5-43e7-b8d8-5899c2906ed8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:08.457475 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b3c7357a-07c5-43e7-b8d8-5899c2906ed8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:08.467158 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b3c7357a-07c5-43e7-b8d8-5899c2906ed8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:08.468676 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b3c7357a-07c5-43e7-b8d8-5899c2906ed8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:08.469890 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-b3c7357a-07c5-43e7-b8d8-5899c2906ed8 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1728 microversion: 2.20 time: 0.213350 Aug 19 21:18:08.470484 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 403/880] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:18:08 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1728 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:18:09.493597 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e907a870-1d45-4f7d-8b08-09a2641b14db tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:09.494851 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-e907a870-1d45-4f7d-8b08-09a2641b14db tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:09.501425 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e907a870-1d45-4f7d-8b08-09a2641b14db tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:09.501957 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e907a870-1d45-4f7d-8b08-09a2641b14db tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:09.502389 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e907a870-1d45-4f7d-8b08-09a2641b14db tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:09.503091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e907a870-1d45-4f7d-8b08-09a2641b14db tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:09.503539 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e907a870-1d45-4f7d-8b08-09a2641b14db tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:09.503968 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e907a870-1d45-4f7d-8b08-09a2641b14db tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:09.647360 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e907a870-1d45-4f7d-8b08-09a2641b14db tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:09.661191 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e907a870-1d45-4f7d-8b08-09a2641b14db tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:09.663980 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e907a870-1d45-4f7d-8b08-09a2641b14db tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:09.666838 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e907a870-1d45-4f7d-8b08-09a2641b14db tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1728 microversion: 2.20 time: 0.177177 Aug 19 21:18:09.667396 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 478/881] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:18:09 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:18:10.690860 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-c021a582-5591-4ad8-8fcb-54a6451612e7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:10.691674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-c021a582-5591-4ad8-8fcb-54a6451612e7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:10.698384 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c021a582-5591-4ad8-8fcb-54a6451612e7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:10.698885 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c021a582-5591-4ad8-8fcb-54a6451612e7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:10.699292 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c021a582-5591-4ad8-8fcb-54a6451612e7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:10.699974 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c021a582-5591-4ad8-8fcb-54a6451612e7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:10.700466 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c021a582-5591-4ad8-8fcb-54a6451612e7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:10.700910 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c021a582-5591-4ad8-8fcb-54a6451612e7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:10.839086 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-c021a582-5591-4ad8-8fcb-54a6451612e7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:10.848794 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-c021a582-5591-4ad8-8fcb-54a6451612e7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:10.850417 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-c021a582-5591-4ad8-8fcb-54a6451612e7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:10.851597 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-c021a582-5591-4ad8-8fcb-54a6451612e7 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1728 microversion: 2.20 time: 0.164642 Aug 19 21:18:10.852154 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 404/882] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:18:10 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:18:11.438982 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-686b1dd4-2ea2-451e-8957-4600aec85b71 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:11.441294 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-686b1dd4-2ea2-451e-8957-4600aec85b71 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:11.448891 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-686b1dd4-2ea2-451e-8957-4600aec85b71 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:11.451846 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-686b1dd4-2ea2-451e-8957-4600aec85b71 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:11.452342 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-686b1dd4-2ea2-451e-8957-4600aec85b71 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:11.454176 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-686b1dd4-2ea2-451e-8957-4600aec85b71 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:11.454644 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-686b1dd4-2ea2-451e-8957-4600aec85b71 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:11.455086 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-686b1dd4-2ea2-451e-8957-4600aec85b71 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:11.486557 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-686b1dd4-2ea2-451e-8957-4600aec85b71 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051427 Aug 19 21:18:11.487118 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 479/883] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Aug 19 21:18:11 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:18:11.498485 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-4a91403a-1948-4b0a-a9e8-ec61e576d645 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:11.498977 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-4a91403a-1948-4b0a-a9e8-ec61e576d645 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:11.504992 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4a91403a-1948-4b0a-a9e8-ec61e576d645 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:11.505480 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4a91403a-1948-4b0a-a9e8-ec61e576d645 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:11.505953 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4a91403a-1948-4b0a-a9e8-ec61e576d645 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:11.506644 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4a91403a-1948-4b0a-a9e8-ec61e576d645 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:11.507106 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4a91403a-1948-4b0a-a9e8-ec61e576d645 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:11.507530 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-4a91403a-1948-4b0a-a9e8-ec61e576d645 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:11.537059 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-4a91403a-1948-4b0a-a9e8-ec61e576d645 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/os-volume_attachments/fbfb5178-8b5d-447b-922c-510c79b21c2d" status: 200 len: 194 microversion: 2.1 time: 0.042503 Aug 19 21:18:11.537626 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 405/884] 10.222.0.16 () {58 vars in 1413 bytes} [Fri Aug 19 21:18:11 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/os-volume_attachments/fbfb5178-8b5d-447b-922c-510c79b21c2d => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:18:11.876465 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0d060be9-5561-410f-942d-fa9c00e3eb16 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:11.877291 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0d060be9-5561-410f-942d-fa9c00e3eb16 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:11.883299 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0d060be9-5561-410f-942d-fa9c00e3eb16 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:11.883782 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0d060be9-5561-410f-942d-fa9c00e3eb16 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:11.884755 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0d060be9-5561-410f-942d-fa9c00e3eb16 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:11.885461 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0d060be9-5561-410f-942d-fa9c00e3eb16 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:11.885953 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0d060be9-5561-410f-942d-fa9c00e3eb16 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:11.886384 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0d060be9-5561-410f-942d-fa9c00e3eb16 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:12.018491 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0d060be9-5561-410f-942d-fa9c00e3eb16 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:12.027340 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0d060be9-5561-410f-942d-fa9c00e3eb16 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:12.028868 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0d060be9-5561-410f-942d-fa9c00e3eb16 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:12.030106 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0d060be9-5561-410f-942d-fa9c00e3eb16 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1728 microversion: 2.20 time: 0.158178 Aug 19 21:18:12.030659 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 480/885] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:18:11 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:18:12.885090 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-9975d3e0-bc89-431f-880b-a528b8f541dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbf2694e-a76a-4e7c-b848-311902d7ef26"}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:18:12.887847 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-9975d3e0-bc89-431f-880b-a528b8f541dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:12.894942 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9975d3e0-bc89-431f-880b-a528b8f541dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:12.895417 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9975d3e0-bc89-431f-880b-a528b8f541dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:12.895848 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9975d3e0-bc89-431f-880b-a528b8f541dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:12.896531 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9975d3e0-bc89-431f-880b-a528b8f541dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:12.896980 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9975d3e0-bc89-431f-880b-a528b8f541dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:12.897395 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9975d3e0-bc89-431f-880b-a528b8f541dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:13.053270 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c8c0f719-0e08-4214-b9c8-5381c4562131 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:13.054051 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-c8c0f719-0e08-4214-b9c8-5381c4562131 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:13.061456 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c8c0f719-0e08-4214-b9c8-5381c4562131 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:13.061988 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c8c0f719-0e08-4214-b9c8-5381c4562131 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:13.062428 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c8c0f719-0e08-4214-b9c8-5381c4562131 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:13.063129 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c8c0f719-0e08-4214-b9c8-5381c4562131 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:13.063616 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c8c0f719-0e08-4214-b9c8-5381c4562131 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:13.064034 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c8c0f719-0e08-4214-b9c8-5381c4562131 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:13.183041 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-9975d3e0-bc89-431f-880b-a528b8f541dd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "POST /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302613 Aug 19 21:18:13.184356 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 406/886] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Aug 19 21:18:12 2022] POST /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:18:13.230955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c8c0f719-0e08-4214-b9c8-5381c4562131 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:13.245198 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c8c0f719-0e08-4214-b9c8-5381c4562131 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:13.247360 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c8c0f719-0e08-4214-b9c8-5381c4562131 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:13.248823 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-c8c0f719-0e08-4214-b9c8-5381c4562131 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1728 microversion: 2.20 time: 0.199571 Aug 19 21:18:13.249966 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 481/887] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:18:13 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1728 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 21:18:14.275339 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-75961a7e-ef4f-4dee-b345-a849c77f0a13 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:14.276044 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-75961a7e-ef4f-4dee-b345-a849c77f0a13 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:14.282714 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-75961a7e-ef4f-4dee-b345-a849c77f0a13 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:14.283216 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-75961a7e-ef4f-4dee-b345-a849c77f0a13 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:14.283659 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-75961a7e-ef4f-4dee-b345-a849c77f0a13 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:14.284400 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-75961a7e-ef4f-4dee-b345-a849c77f0a13 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:14.284884 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-75961a7e-ef4f-4dee-b345-a849c77f0a13 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:14.285310 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-75961a7e-ef4f-4dee-b345-a849c77f0a13 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:14.424794 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-75961a7e-ef4f-4dee-b345-a849c77f0a13 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:14.433544 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-75961a7e-ef4f-4dee-b345-a849c77f0a13 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:14.435075 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-75961a7e-ef4f-4dee-b345-a849c77f0a13 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:14.436231 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-75961a7e-ef4f-4dee-b345-a849c77f0a13 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1728 microversion: 2.20 time: 0.166450 Aug 19 21:18:14.436791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 407/888] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:18:14 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:18:14.745482 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-2e9e8eb2-db98-4a6e-bb8c-8f58d6753e24 req-e6557efa-1544-4559-a00a-93534119b9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5be0a3d-0419-4d69-83b2-22939e9c9bce", "name": "network-vif-plugged", "status": "completed", "tag": "eb7288c4-808b-4ef2-91d6-8f6c15db4227"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:18:14.756034 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-2e9e8eb2-db98-4a6e-bb8c-8f58d6753e24 req-e6557efa-1544-4559-a00a-93534119b9f9 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:14.756511 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-2e9e8eb2-db98-4a6e-bb8c-8f58d6753e24 req-e6557efa-1544-4559-a00a-93534119b9f9 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:14.757993 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-2e9e8eb2-db98-4a6e-bb8c-8f58d6753e24 req-e6557efa-1544-4559-a00a-93534119b9f9 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:14.770674 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-2e9e8eb2-db98-4a6e-bb8c-8f58d6753e24 req-e6557efa-1544-4559-a00a-93534119b9f9 service nova] Creating event network-vif-plugged:eb7288c4-808b-4ef2-91d6-8f6c15db4227 for instance e5be0a3d-0419-4d69-83b2-22939e9c9bce on hv-cinder-85220 Aug 19 21:18:14.776832 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-2e9e8eb2-db98-4a6e-bb8c-8f58d6753e24 req-e6557efa-1544-4559-a00a-93534119b9f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036258 Aug 19 21:18:14.777610 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 482/889] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:18:15.459259 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-12559359-a61a-4d8c-a941-68fc055a3e6f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:15.459845 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-12559359-a61a-4d8c-a941-68fc055a3e6f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:15.467257 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-12559359-a61a-4d8c-a941-68fc055a3e6f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:15.467730 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-12559359-a61a-4d8c-a941-68fc055a3e6f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:15.468155 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-12559359-a61a-4d8c-a941-68fc055a3e6f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:15.468836 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-12559359-a61a-4d8c-a941-68fc055a3e6f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:15.469281 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-12559359-a61a-4d8c-a941-68fc055a3e6f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:15.469693 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-12559359-a61a-4d8c-a941-68fc055a3e6f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:15.607484 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-12559359-a61a-4d8c-a941-68fc055a3e6f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:15.615715 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-12559359-a61a-4d8c-a941-68fc055a3e6f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:15.617211 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-12559359-a61a-4d8c-a941-68fc055a3e6f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:15.618462 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-12559359-a61a-4d8c-a941-68fc055a3e6f tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1728 microversion: 2.20 time: 0.163034 Aug 19 21:18:15.619065 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 408/890] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:18:15 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:18:16.643365 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e9afdc45-39bb-4c60-b8b8-11f349ab54c2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:16.643998 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-e9afdc45-39bb-4c60-b8b8-11f349ab54c2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:16.653124 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e9afdc45-39bb-4c60-b8b8-11f349ab54c2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:16.653622 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e9afdc45-39bb-4c60-b8b8-11f349ab54c2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:16.654091 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e9afdc45-39bb-4c60-b8b8-11f349ab54c2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:16.654948 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e9afdc45-39bb-4c60-b8b8-11f349ab54c2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:16.655540 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e9afdc45-39bb-4c60-b8b8-11f349ab54c2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:16.655938 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e9afdc45-39bb-4c60-b8b8-11f349ab54c2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:16.819657 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e9afdc45-39bb-4c60-b8b8-11f349ab54c2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:16.829746 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e9afdc45-39bb-4c60-b8b8-11f349ab54c2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:16.831389 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e9afdc45-39bb-4c60-b8b8-11f349ab54c2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:16.832566 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e9afdc45-39bb-4c60-b8b8-11f349ab54c2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1728 microversion: 2.20 time: 0.195512 Aug 19 21:18:16.833122 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 483/891] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:18:16 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1728 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:18:17.858590 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-7c1e6a70-982a-4e3a-bfcf-fcba77ffe631 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:17.859186 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-7c1e6a70-982a-4e3a-bfcf-fcba77ffe631 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:17.865905 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7c1e6a70-982a-4e3a-bfcf-fcba77ffe631 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:17.866392 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7c1e6a70-982a-4e3a-bfcf-fcba77ffe631 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:17.867031 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7c1e6a70-982a-4e3a-bfcf-fcba77ffe631 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:17.867728 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7c1e6a70-982a-4e3a-bfcf-fcba77ffe631 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:17.868181 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7c1e6a70-982a-4e3a-bfcf-fcba77ffe631 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:17.868898 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7c1e6a70-982a-4e3a-bfcf-fcba77ffe631 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:18.004963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-7c1e6a70-982a-4e3a-bfcf-fcba77ffe631 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:18.014133 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-7c1e6a70-982a-4e3a-bfcf-fcba77ffe631 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:18.015947 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-7c1e6a70-982a-4e3a-bfcf-fcba77ffe631 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:18.017100 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-7c1e6a70-982a-4e3a-bfcf-fcba77ffe631 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1715 microversion: 2.20 time: 0.162488 Aug 19 21:18:18.017662 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 409/892] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:18:17 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1715 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:18:20.752556 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3cec7960-e961-41ed-a9ff-4db3fbe56aeb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:20.754745 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-3cec7960-e961-41ed-a9ff-4db3fbe56aeb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:20.761818 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3cec7960-e961-41ed-a9ff-4db3fbe56aeb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:20.762308 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3cec7960-e961-41ed-a9ff-4db3fbe56aeb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:20.762746 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3cec7960-e961-41ed-a9ff-4db3fbe56aeb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:20.763444 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3cec7960-e961-41ed-a9ff-4db3fbe56aeb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:20.763907 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3cec7960-e961-41ed-a9ff-4db3fbe56aeb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:20.764341 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3cec7960-e961-41ed-a9ff-4db3fbe56aeb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:20.798942 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-3cec7960-e961-41ed-a9ff-4db3fbe56aeb tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050282 Aug 19 21:18:20.799506 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 484/893] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Aug 19 21:18:20 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:18:20.940544 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-3df633de-7bba-4dd7-9a65-9f4d858377de tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:20.941097 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-3df633de-7bba-4dd7-9a65-9f4d858377de tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:20.947845 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3df633de-7bba-4dd7-9a65-9f4d858377de tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:20.948324 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3df633de-7bba-4dd7-9a65-9f4d858377de tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:20.948761 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3df633de-7bba-4dd7-9a65-9f4d858377de tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:20.949457 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3df633de-7bba-4dd7-9a65-9f4d858377de tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:20.949940 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3df633de-7bba-4dd7-9a65-9f4d858377de tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:20.950359 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3df633de-7bba-4dd7-9a65-9f4d858377de tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:20.981117 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-3df633de-7bba-4dd7-9a65-9f4d858377de tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/os-volume_attachments/fbfb5178-8b5d-447b-922c-510c79b21c2d" status: 200 len: 194 microversion: 2.1 time: 0.044547 Aug 19 21:18:20.981703 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 410/894] 10.222.0.16 () {58 vars in 1413 bytes} [Fri Aug 19 21:18:20 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/os-volume_attachments/fbfb5178-8b5d-447b-922c-510c79b21c2d => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:18:20.991956 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-b16e552f-0781-41a7-9f19-6e3ca4dbb14c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:20.992442 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-b16e552f-0781-41a7-9f19-6e3ca4dbb14c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:20.999396 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b16e552f-0781-41a7-9f19-6e3ca4dbb14c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:20.999887 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b16e552f-0781-41a7-9f19-6e3ca4dbb14c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:21.000325 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b16e552f-0781-41a7-9f19-6e3ca4dbb14c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:21.001019 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b16e552f-0781-41a7-9f19-6e3ca4dbb14c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:21.001477 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b16e552f-0781-41a7-9f19-6e3ca4dbb14c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:21.001942 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b16e552f-0781-41a7-9f19-6e3ca4dbb14c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:21.083867 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:18:21.089109 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.objects.instance [None req-b16e552f-0781-41a7-9f19-6e3ca4dbb14c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lazy-loading 'services' on Instance uuid 8999d988-6f08-4866-9aeb-61070698d7aa {{(pid=120877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:18:21.164580 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-b16e552f-0781-41a7-9f19-6e3ca4dbb14c tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/os-volume_attachments/fbfb5178-8b5d-447b-922c-510c79b21c2d" status: 202 len: 0 microversion: 2.1 time: 0.176415 Aug 19 21:18:21.166067 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 485/895] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Aug 19 21:18:20 2022] DELETE /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/os-volume_attachments/fbfb5178-8b5d-447b-922c-510c79b21c2d => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:18:22.288517 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-84f9251e-6fa2-4555-b55a-a081591358b1 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:22.289019 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-84f9251e-6fa2-4555-b55a-a081591358b1 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:22.295901 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-84f9251e-6fa2-4555-b55a-a081591358b1 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:22.296387 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-84f9251e-6fa2-4555-b55a-a081591358b1 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:22.296818 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-84f9251e-6fa2-4555-b55a-a081591358b1 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:22.297504 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-84f9251e-6fa2-4555-b55a-a081591358b1 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:22.298035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-84f9251e-6fa2-4555-b55a-a081591358b1 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:22.298462 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-84f9251e-6fa2-4555-b55a-a081591358b1 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:22.327495 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-84f9251e-6fa2-4555-b55a-a081591358b1 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/os-volume_attachments/bbf2694e-a76a-4e7c-b848-311902d7ef26" status: 200 len: 194 microversion: 2.1 time: 0.042905 Aug 19 21:18:22.328137 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 411/896] 10.222.0.16 () {58 vars in 1413 bytes} [Fri Aug 19 21:18:22 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/os-volume_attachments/bbf2694e-a76a-4e7c-b848-311902d7ef26 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:18:22.340378 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-6c703b59-1ef6-4811-b8f7-06fe0a2fb8d4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:22.340942 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-6c703b59-1ef6-4811-b8f7-06fe0a2fb8d4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:22.347248 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6c703b59-1ef6-4811-b8f7-06fe0a2fb8d4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:22.347730 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6c703b59-1ef6-4811-b8f7-06fe0a2fb8d4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:22.348160 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6c703b59-1ef6-4811-b8f7-06fe0a2fb8d4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:22.348849 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6c703b59-1ef6-4811-b8f7-06fe0a2fb8d4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:22.349297 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6c703b59-1ef6-4811-b8f7-06fe0a2fb8d4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:22.349714 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-6c703b59-1ef6-4811-b8f7-06fe0a2fb8d4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:22.432117 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.objects.instance [None req-6c703b59-1ef6-4811-b8f7-06fe0a2fb8d4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lazy-loading 'services' on Instance uuid 8999d988-6f08-4866-9aeb-61070698d7aa {{(pid=120877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:18:22.504355 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-6c703b59-1ef6-4811-b8f7-06fe0a2fb8d4 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/os-volume_attachments/bbf2694e-a76a-4e7c-b848-311902d7ef26" status: 202 len: 0 microversion: 2.1 time: 0.169045 Aug 19 21:18:22.504930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 486/897] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Aug 19 21:18:22 2022] DELETE /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/os-volume_attachments/bbf2694e-a76a-4e7c-b848-311902d7ef26 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:18:23.677507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-6ff95728-94b4-4ce4-a869-00c5361038d9 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:23.679830 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-6ff95728-94b4-4ce4-a869-00c5361038d9 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:23.686788 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6ff95728-94b4-4ce4-a869-00c5361038d9 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:23.687269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6ff95728-94b4-4ce4-a869-00c5361038d9 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:23.687700 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6ff95728-94b4-4ce4-a869-00c5361038d9 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:23.688380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6ff95728-94b4-4ce4-a869-00c5361038d9 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:23.688831 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6ff95728-94b4-4ce4-a869-00c5361038d9 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:23.689248 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6ff95728-94b4-4ce4-a869-00c5361038d9 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:23.718148 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-6ff95728-94b4-4ce4-a869-00c5361038d9 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044539 Aug 19 21:18:23.718721 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 412/898] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Aug 19 21:18:23 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 21:18:23.836092 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3effe201-e433-4495-901e-970b37ce23ef tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:23.838995 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-3effe201-e433-4495-901e-970b37ce23ef tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:23.845209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3effe201-e433-4495-901e-970b37ce23ef tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:23.845682 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3effe201-e433-4495-901e-970b37ce23ef tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:23.846144 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3effe201-e433-4495-901e-970b37ce23ef tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:23.846831 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3effe201-e433-4495-901e-970b37ce23ef tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:23.847280 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3effe201-e433-4495-901e-970b37ce23ef tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:23.847696 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3effe201-e433-4495-901e-970b37ce23ef tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:23.876127 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-3effe201-e433-4495-901e-970b37ce23ef tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044979 Aug 19 21:18:23.876675 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 487/899] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Aug 19 21:18:23 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 21:18:23.937947 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-28d9d766-4820-4ed3-be4e-9c0c1ffa671d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:23.938470 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-28d9d766-4820-4ed3-be4e-9c0c1ffa671d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:23.944482 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-28d9d766-4820-4ed3-be4e-9c0c1ffa671d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:23.944972 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-28d9d766-4820-4ed3-be4e-9c0c1ffa671d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:23.945453 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-28d9d766-4820-4ed3-be4e-9c0c1ffa671d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:23.946233 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-28d9d766-4820-4ed3-be4e-9c0c1ffa671d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:23.947221 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-28d9d766-4820-4ed3-be4e-9c0c1ffa671d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:23.947647 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-28d9d766-4820-4ed3-be4e-9c0c1ffa671d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:23.973628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-28d9d766-4820-4ed3-be4e-9c0c1ffa671d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Going to try to terminate instance {{(pid=120876) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 21:18:23.987875 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:18:24.053169 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-28d9d766-4820-4ed3-be4e-9c0c1ffa671d tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa" status: 204 len: 0 microversion: 2.1 time: 0.118789 Aug 19 21:18:24.053861 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 413/900] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:18:23 2022] DELETE /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 21:18:24.062968 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-5a606e14-5eca-4d74-b7df-4589c5dc5583 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:24.063594 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-5a606e14-5eca-4d74-b7df-4589c5dc5583 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:24.069710 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5a606e14-5eca-4d74-b7df-4589c5dc5583 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:24.070260 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5a606e14-5eca-4d74-b7df-4589c5dc5583 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:24.070728 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5a606e14-5eca-4d74-b7df-4589c5dc5583 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:24.071942 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5a606e14-5eca-4d74-b7df-4589c5dc5583 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:24.072645 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5a606e14-5eca-4d74-b7df-4589c5dc5583 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:24.073069 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5a606e14-5eca-4d74-b7df-4589c5dc5583 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:24.208872 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-5a606e14-5eca-4d74-b7df-4589c5dc5583 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:24.217382 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-5a606e14-5eca-4d74-b7df-4589c5dc5583 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa" status: 200 len: 1672 microversion: 2.1 time: 0.158651 Aug 19 21:18:24.217989 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 488/901] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:18:24 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:18:25.240078 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-fcf6386c-67cb-43ad-9888-4624f5046a63 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:25.240779 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-fcf6386c-67cb-43ad-9888-4624f5046a63 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:25.248082 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fcf6386c-67cb-43ad-9888-4624f5046a63 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:25.248585 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fcf6386c-67cb-43ad-9888-4624f5046a63 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:25.249013 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fcf6386c-67cb-43ad-9888-4624f5046a63 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:25.249696 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fcf6386c-67cb-43ad-9888-4624f5046a63 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:25.250179 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fcf6386c-67cb-43ad-9888-4624f5046a63 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:25.250595 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fcf6386c-67cb-43ad-9888-4624f5046a63 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:25.382599 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-fcf6386c-67cb-43ad-9888-4624f5046a63 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:25.390731 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-fcf6386c-67cb-43ad-9888-4624f5046a63 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa" status: 200 len: 1672 microversion: 2.1 time: 0.155021 Aug 19 21:18:25.391296 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 414/902] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:18:25 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:18:26.412062 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-006cf21c-c8e3-4e38-8033-4907affa1c39 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:26.413006 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-006cf21c-c8e3-4e38-8033-4907affa1c39 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:26.420385 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-006cf21c-c8e3-4e38-8033-4907affa1c39 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:26.420875 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-006cf21c-c8e3-4e38-8033-4907affa1c39 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:26.421310 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-006cf21c-c8e3-4e38-8033-4907affa1c39 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:26.422029 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-006cf21c-c8e3-4e38-8033-4907affa1c39 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:26.422483 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-006cf21c-c8e3-4e38-8033-4907affa1c39 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:26.422904 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-006cf21c-c8e3-4e38-8033-4907affa1c39 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:26.579188 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-006cf21c-c8e3-4e38-8033-4907affa1c39 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8810b3e211d448cea9a506d9183dc13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def1895e8f3b40f1b608240c60a0066a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:18:26.587142 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-006cf21c-c8e3-4e38-8033-4907affa1c39 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa" status: 200 len: 1672 microversion: 2.1 time: 0.179221 Aug 19 21:18:26.587722 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 489/903] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:18:26 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa => generated 1672 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:18:27.063096 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-eaaebf4b-8312-4fab-b940-18dd52b07b8c req-33866cda-829f-496b-ab05-470e04cc51db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8999d988-6f08-4866-9aeb-61070698d7aa", "name": "network-vif-deleted", "tag": "2c8e7c10-6166-4c38-8790-ffeaa8c7b236"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:18:27.073963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-eaaebf4b-8312-4fab-b940-18dd52b07b8c req-33866cda-829f-496b-ab05-470e04cc51db service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:27.074445 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-eaaebf4b-8312-4fab-b940-18dd52b07b8c req-33866cda-829f-496b-ab05-470e04cc51db service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:27.074869 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-eaaebf4b-8312-4fab-b940-18dd52b07b8c req-33866cda-829f-496b-ab05-470e04cc51db service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:27.086370 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-eaaebf4b-8312-4fab-b940-18dd52b07b8c req-33866cda-829f-496b-ab05-470e04cc51db service nova] Creating event network-vif-deleted:2c8e7c10-6166-4c38-8790-ffeaa8c7b236 for instance 8999d988-6f08-4866-9aeb-61070698d7aa on hv-cinder-85220 Aug 19 21:18:27.093056 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-eaaebf4b-8312-4fab-b940-18dd52b07b8c req-33866cda-829f-496b-ab05-470e04cc51db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033436 Aug 19 21:18:27.093666 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 415/904] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:18:27.609501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0c5f1f28-689a-4398-b594-a8936ccfaebd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:27.610191 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0c5f1f28-689a-4398-b594-a8936ccfaebd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:27.616828 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0c5f1f28-689a-4398-b594-a8936ccfaebd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:27.617428 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0c5f1f28-689a-4398-b594-a8936ccfaebd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:27.617887 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0c5f1f28-689a-4398-b594-a8936ccfaebd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:27.619289 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0c5f1f28-689a-4398-b594-a8936ccfaebd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:27.619739 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0c5f1f28-689a-4398-b594-a8936ccfaebd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:27.620212 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0c5f1f28-689a-4398-b594-a8936ccfaebd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:27.636751 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-0c5f1f28-689a-4398-b594-a8936ccfaebd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] HTTP exception thrown: Instance 8999d988-6f08-4866-9aeb-61070698d7aa could not be found. Aug 19 21:18:27.638454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0c5f1f28-689a-4398-b594-a8936ccfaebd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Request method failure captured: Aug 19 21:18:27.638454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa HTTP/1.1 Aug 19 21:18:27.638454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:18:27.638454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:18:27.638454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:18:27.638454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:18:27.638454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:18:27.638454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:18:27.638454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:18:27.638454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:18:27.638454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__vd26Cb0mXv7t9M5WFOOYHhu6_1HXA35W3ospma2g9U7sFDdcDTQIBuuoLDY5brtQJDBOpSgsAo54GXcjus4z5BsvW7cJ7smrx8rnFYGq_2bFs80-KKshEc83AxCejow5QNEXpsTZyIuhP6mkHnlceVP0v4B7UulMMVywTQ5WGeB4E Aug 19 21:18:27.638454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:18:27.638454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:18:27.638454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:18:27.638454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:18:27.638454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:18:27.638454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:18:27.638454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: def1895e8f3b40f1b608240c60a0066a Aug 19 21:18:27.638454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-AttachVolumeTestJSON-66626407 Aug 19 21:18:27.638454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:18:27.638454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:18:27.640246 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/def1895e8f3b40f1b608240c60a0066a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/def1895e8f3b40f1b608240c60a0066a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_def1895e8f3b40f1b608240c60a0066a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/def1895e8f3b40f1b608240c60a0066a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:18:27.640246 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-AttachVolumeTestJSON-66626407 Aug 19 21:18:27.640246 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: def1895e8f3b40f1b608240c60a0066a Aug 19 21:18:27.640246 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-AttachVolumeTestJSON-66626407 Aug 19 21:18:27.640246 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-AttachVolumeTestJSON-66626407-project Aug 19 21:18:27.640246 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:18:27.640246 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:18:27.640246 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: 8810b3e211d448cea9a506d9183dc13d Aug 19 21:18:27.640246 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-AttachVolumeTestJSON-66626407-project Aug 19 21:18:27.640246 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: > Aug 19 21:18:27.640246 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Instance 8999d988-6f08-4866-9aeb-61070698d7aa could not be found. Aug 19 21:18:27.640246 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'id': '8999d988-6f08-4866-9aeb-61070698d7aa'} Aug 19 21:18:27.641009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:18:27.641009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:18:27.641009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:18:27.641009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:18:27.641009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:18:27.641009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:18:27.641009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:18:27.641009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:18:27.641009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:18:27.641009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:18:27.641009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8999d988-6f08-4866-9aeb-61070698d7aa could not be found. Aug 19 21:18:27.641009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:18:27.641009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:18:27.641009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:18:27.641009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:18:27.641009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:18:27.641009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:18:27.641009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:18:27.641009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:18:27.641009 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:18:27.642331 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:18:27.642331 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:18:27.642331 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:18:27.642331 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:18:27.642331 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:18:27.642331 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:18:27.642331 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:18:27.642331 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8999d988-6f08-4866-9aeb-61070698d7aa could not be found. Aug 19 21:18:27.642331 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:18:27.642331 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:18:27.642331 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:18:27.642331 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:18:27.642331 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:18:27.642331 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:18:27.642331 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:18:27.642331 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:18:27.642331 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8999d988-6f08-4866-9aeb-61070698d7aa could not be found. Aug 19 21:18:27.642331 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:18:27.643514 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0c5f1f28-689a-4398-b594-a8936ccfaebd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Returning 404 to user: Instance 8999d988-6f08-4866-9aeb-61070698d7aa could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:18:27.643514 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0c5f1f28-689a-4398-b594-a8936ccfaebd tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa" status: 404 len: 111 microversion: 2.1 time: 0.034271 Aug 19 21:18:27.643514 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 490/905] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:18:27 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:18:27.649477 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-a653e740-4297-4dbc-9bbd-ae9dcc141652 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '.version_select at 0x7f740bd7f5e0>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:27.673020 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-a653e740-4297-4dbc-9bbd-ae9dcc141652 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112281432" status: 202 len: 0 microversion: 2.1 time: 0.027553 Aug 19 21:18:27.673604 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 416/906] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Aug 19 21:18:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112281432 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:18:30.624816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3e26b383-18b1-4941-9c3e-36fec39c4c04 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:30.625358 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-3e26b383-18b1-4941-9c3e-36fec39c4c04 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:30.631778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3e26b383-18b1-4941-9c3e-36fec39c4c04 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:30.632255 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3e26b383-18b1-4941-9c3e-36fec39c4c04 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:30.632685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3e26b383-18b1-4941-9c3e-36fec39c4c04 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:30.633371 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3e26b383-18b1-4941-9c3e-36fec39c4c04 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:30.633846 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3e26b383-18b1-4941-9c3e-36fec39c4c04 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:30.634272 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3e26b383-18b1-4941-9c3e-36fec39c4c04 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:30.648268 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-3e26b383-18b1-4941-9c3e-36fec39c4c04 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] HTTP exception thrown: Instance 8999d988-6f08-4866-9aeb-61070698d7aa could not be found. Aug 19 21:18:30.650162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3e26b383-18b1-4941-9c3e-36fec39c4c04 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Request method failure captured: Aug 19 21:18:30.650162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: DELETE /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa HTTP/1.1 Aug 19 21:18:30.650162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:18:30.650162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:18:30.650162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:18:30.650162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:18:30.650162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:18:30.650162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:18:30.650162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:18:30.650162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:18:30.650162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__vd26Cb0mXv7t9M5WFOOYHhu6_1HXA35W3ospma2g9U7sFDdcDTQIBuuoLDY5brtQJDBOpSgsAo54GXcjus4z5BsvW7cJ7smrx8rnFYGq_2bFs80-KKshEc83AxCejow5QNEXpsTZyIuhP6mkHnlceVP0v4B7UulMMVywTQ5WGeB4E Aug 19 21:18:30.650162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:18:30.650162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:18:30.650162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:18:30.650162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:18:30.650162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:18:30.650162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:18:30.650162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: def1895e8f3b40f1b608240c60a0066a Aug 19 21:18:30.650162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-AttachVolumeTestJSON-66626407 Aug 19 21:18:30.650162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:18:30.650162 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:18:30.651767 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/def1895e8f3b40f1b608240c60a0066a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/def1895e8f3b40f1b608240c60a0066a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_def1895e8f3b40f1b608240c60a0066a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/def1895e8f3b40f1b608240c60a0066a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:18:30.651767 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-AttachVolumeTestJSON-66626407 Aug 19 21:18:30.651767 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: def1895e8f3b40f1b608240c60a0066a Aug 19 21:18:30.651767 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-AttachVolumeTestJSON-66626407 Aug 19 21:18:30.651767 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-AttachVolumeTestJSON-66626407-project Aug 19 21:18:30.651767 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:18:30.651767 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:18:30.651767 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: 8810b3e211d448cea9a506d9183dc13d Aug 19 21:18:30.651767 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-AttachVolumeTestJSON-66626407-project Aug 19 21:18:30.651767 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: > Aug 19 21:18:30.651767 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Instance 8999d988-6f08-4866-9aeb-61070698d7aa could not be found. Aug 19 21:18:30.651767 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'id': '8999d988-6f08-4866-9aeb-61070698d7aa'} Aug 19 21:18:30.653388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:18:30.653388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:18:30.653388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:18:30.653388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:18:30.653388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:18:30.653388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:18:30.653388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:18:30.653388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:18:30.653388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:18:30.653388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:18:30.653388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8999d988-6f08-4866-9aeb-61070698d7aa could not be found. Aug 19 21:18:30.653388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:18:30.653388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:18:30.653388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:18:30.653388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:18:30.653388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:18:30.653388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:18:30.653388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:18:30.653388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:18:30.653388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:18:30.654952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:18:30.654952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 21:18:30.654952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 21:18:30.654952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 21:18:30.654952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 21:18:30.654952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:18:30.654952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:18:30.654952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:18:30.654952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:18:30.654952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8999d988-6f08-4866-9aeb-61070698d7aa could not be found. Aug 19 21:18:30.654952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:18:30.654952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:18:30.654952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:18:30.654952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:18:30.654952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:18:30.654952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:18:30.654952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:18:30.654952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:18:30.654952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8999d988-6f08-4866-9aeb-61070698d7aa could not be found. Aug 19 21:18:30.654952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:18:30.656404 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3e26b383-18b1-4941-9c3e-36fec39c4c04 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Returning 404 to user: Instance 8999d988-6f08-4866-9aeb-61070698d7aa could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:18:30.656404 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-3e26b383-18b1-4941-9c3e-36fec39c4c04 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa" status: 404 len: 111 microversion: 2.1 time: 0.030465 Aug 19 21:18:30.656404 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 491/907] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:18:30 2022] DELETE /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:18:30.660586 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-5478e25e-315b-4397-96cb-9e0de6fe7853 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:30.661316 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-5478e25e-315b-4397-96cb-9e0de6fe7853 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: 8999d988-6f08-4866-9aeb-61070698d7aa] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:30.667957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5478e25e-315b-4397-96cb-9e0de6fe7853 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:30.668438 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5478e25e-315b-4397-96cb-9e0de6fe7853 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:30.668897 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5478e25e-315b-4397-96cb-9e0de6fe7853 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:30.669576 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5478e25e-315b-4397-96cb-9e0de6fe7853 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:30.670079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5478e25e-315b-4397-96cb-9e0de6fe7853 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:30.670496 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5478e25e-315b-4397-96cb-9e0de6fe7853 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:30.684346 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-5478e25e-315b-4397-96cb-9e0de6fe7853 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] HTTP exception thrown: Instance 8999d988-6f08-4866-9aeb-61070698d7aa could not be found. Aug 19 21:18:30.686017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-5478e25e-315b-4397-96cb-9e0de6fe7853 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Request method failure captured: Aug 19 21:18:30.686017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa HTTP/1.1 Aug 19 21:18:30.686017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:18:30.686017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:18:30.686017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:18:30.686017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:18:30.686017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:18:30.686017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:18:30.686017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:18:30.686017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:18:30.686017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__vd26Cb0mXv7t9M5WFOOYHhu6_1HXA35W3ospma2g9U7sFDdcDTQIBuuoLDY5brtQJDBOpSgsAo54GXcjus4z5BsvW7cJ7smrx8rnFYGq_2bFs80-KKshEc83AxCejow5QNEXpsTZyIuhP6mkHnlceVP0v4B7UulMMVywTQ5WGeB4E Aug 19 21:18:30.686017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:18:30.686017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:18:30.686017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:18:30.686017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:18:30.686017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:18:30.686017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:18:30.686017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: def1895e8f3b40f1b608240c60a0066a Aug 19 21:18:30.686017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-AttachVolumeTestJSON-66626407 Aug 19 21:18:30.686017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:18:30.686017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:18:30.687596 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/def1895e8f3b40f1b608240c60a0066a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/def1895e8f3b40f1b608240c60a0066a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_def1895e8f3b40f1b608240c60a0066a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/def1895e8f3b40f1b608240c60a0066a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:18:30.687596 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-AttachVolumeTestJSON-66626407 Aug 19 21:18:30.687596 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: def1895e8f3b40f1b608240c60a0066a Aug 19 21:18:30.687596 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-AttachVolumeTestJSON-66626407 Aug 19 21:18:30.687596 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-AttachVolumeTestJSON-66626407-project Aug 19 21:18:30.687596 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:18:30.687596 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:18:30.687596 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: 8810b3e211d448cea9a506d9183dc13d Aug 19 21:18:30.687596 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-AttachVolumeTestJSON-66626407-project Aug 19 21:18:30.687596 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: > Aug 19 21:18:30.687596 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Instance 8999d988-6f08-4866-9aeb-61070698d7aa could not be found. Aug 19 21:18:30.687596 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': '8999d988-6f08-4866-9aeb-61070698d7aa'} Aug 19 21:18:30.691453 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:18:30.691453 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:18:30.691453 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:18:30.691453 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:18:30.691453 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:18:30.691453 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:18:30.691453 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:18:30.691453 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:18:30.691453 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:18:30.691453 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:18:30.691453 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8999d988-6f08-4866-9aeb-61070698d7aa could not be found. Aug 19 21:18:30.691453 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:18:30.691453 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:18:30.691453 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:18:30.691453 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:18:30.691453 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:18:30.691453 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:18:30.691453 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:18:30.691453 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:18:30.691453 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:18:30.692685 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:18:30.692685 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:18:30.692685 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:18:30.692685 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:18:30.692685 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:18:30.692685 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:18:30.692685 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:18:30.692685 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8999d988-6f08-4866-9aeb-61070698d7aa could not be found. Aug 19 21:18:30.692685 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:18:30.692685 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:18:30.692685 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:18:30.692685 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:18:30.692685 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:18:30.692685 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:18:30.692685 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:18:30.692685 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:18:30.692685 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8999d988-6f08-4866-9aeb-61070698d7aa could not be found. Aug 19 21:18:30.692685 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:18:30.694332 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-5478e25e-315b-4397-96cb-9e0de6fe7853 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Returning 404 to user: Instance 8999d988-6f08-4866-9aeb-61070698d7aa could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:18:30.694332 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-5478e25e-315b-4397-96cb-9e0de6fe7853 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa" status: 404 len: 111 microversion: 2.1 time: 0.031313 Aug 19 21:18:30.694332 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 417/908] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:18:30 2022] GET /compute/v2.1/servers/8999d988-6f08-4866-9aeb-61070698d7aa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 19 21:18:31.835581 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-4cf8fc97-b27e-476d-b132-e52b1a35f088 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:31.836138 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-4cf8fc97-b27e-476d-b132-e52b1a35f088 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:31.842629 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4cf8fc97-b27e-476d-b132-e52b1a35f088 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:31.843109 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4cf8fc97-b27e-476d-b132-e52b1a35f088 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:31.843539 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4cf8fc97-b27e-476d-b132-e52b1a35f088 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:31.844217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4cf8fc97-b27e-476d-b132-e52b1a35f088 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:31.844669 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4cf8fc97-b27e-476d-b132-e52b1a35f088 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:31.845086 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4cf8fc97-b27e-476d-b132-e52b1a35f088 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:31.858914 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-4cf8fc97-b27e-476d-b132-e52b1a35f088 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] HTTP exception thrown: Instance d7e25852-2606-4138-b039-56a9ed0b7f1e could not be found. Aug 19 21:18:31.860687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-4cf8fc97-b27e-476d-b132-e52b1a35f088 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Request method failure captured: Aug 19 21:18:31.860687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: DELETE /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e HTTP/1.1 Aug 19 21:18:31.860687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:18:31.860687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:18:31.860687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:18:31.860687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:18:31.860687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:18:31.860687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:18:31.860687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:18:31.860687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:18:31.860687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__vd26Cb0mXv7t9M5WFOOYHhu6_1HXA35W3ospma2g9U7sFDdcDTQIBuuoLDY5brtQJDBOpSgsAo54GXcjus4z5BsvW7cJ7smrx8rnFYGq_2bFs80-KKshEc83AxCejow5QNEXpsTZyIuhP6mkHnlceVP0v4B7UulMMVywTQ5WGeB4E Aug 19 21:18:31.860687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:18:31.860687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:18:31.860687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:18:31.860687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:18:31.860687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:18:31.860687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:18:31.860687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: def1895e8f3b40f1b608240c60a0066a Aug 19 21:18:31.860687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-AttachVolumeTestJSON-66626407 Aug 19 21:18:31.860687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:18:31.860687 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:18:31.862127 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/def1895e8f3b40f1b608240c60a0066a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/def1895e8f3b40f1b608240c60a0066a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_def1895e8f3b40f1b608240c60a0066a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/def1895e8f3b40f1b608240c60a0066a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:18:31.862127 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-AttachVolumeTestJSON-66626407 Aug 19 21:18:31.862127 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: def1895e8f3b40f1b608240c60a0066a Aug 19 21:18:31.862127 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-AttachVolumeTestJSON-66626407 Aug 19 21:18:31.862127 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-AttachVolumeTestJSON-66626407-project Aug 19 21:18:31.862127 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:18:31.862127 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:18:31.862127 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: 8810b3e211d448cea9a506d9183dc13d Aug 19 21:18:31.862127 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-AttachVolumeTestJSON-66626407-project Aug 19 21:18:31.862127 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: > Aug 19 21:18:31.862127 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Instance d7e25852-2606-4138-b039-56a9ed0b7f1e could not be found. Aug 19 21:18:31.862127 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'id': 'd7e25852-2606-4138-b039-56a9ed0b7f1e'} Aug 19 21:18:31.862884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:18:31.862884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:18:31.862884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:18:31.862884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:18:31.862884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:18:31.862884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:18:31.862884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:18:31.862884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:18:31.862884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:18:31.862884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:18:31.862884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e25852-2606-4138-b039-56a9ed0b7f1e could not be found. Aug 19 21:18:31.862884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:18:31.862884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:18:31.862884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:18:31.862884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:18:31.862884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:18:31.862884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:18:31.862884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:18:31.862884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:18:31.862884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:18:31.864141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:18:31.864141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 21:18:31.864141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 21:18:31.864141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 21:18:31.864141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 21:18:31.864141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:18:31.864141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:18:31.864141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:18:31.864141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:18:31.864141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e25852-2606-4138-b039-56a9ed0b7f1e could not be found. Aug 19 21:18:31.864141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:18:31.864141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:18:31.864141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:18:31.864141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:18:31.864141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:18:31.864141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:18:31.864141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:18:31.864141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:18:31.864141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e25852-2606-4138-b039-56a9ed0b7f1e could not be found. Aug 19 21:18:31.864141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:18:31.865346 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-4cf8fc97-b27e-476d-b132-e52b1a35f088 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Returning 404 to user: Instance d7e25852-2606-4138-b039-56a9ed0b7f1e could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:18:31.865346 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-4cf8fc97-b27e-476d-b132-e52b1a35f088 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 404 len: 111 microversion: 2.1 time: 0.030430 Aug 19 21:18:31.865346 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 492/909] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:18:31 2022] DELETE /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:18:31.871266 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-c71cd2e4-15eb-4769-9a15-160826c0ef30 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:31.871893 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-c71cd2e4-15eb-4769-9a15-160826c0ef30 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] [instance: d7e25852-2606-4138-b039-56a9ed0b7f1e] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:31.878401 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c71cd2e4-15eb-4769-9a15-160826c0ef30 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:31.878875 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c71cd2e4-15eb-4769-9a15-160826c0ef30 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:31.879298 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c71cd2e4-15eb-4769-9a15-160826c0ef30 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:31.879979 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c71cd2e4-15eb-4769-9a15-160826c0ef30 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:31.880422 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c71cd2e4-15eb-4769-9a15-160826c0ef30 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:31.880832 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c71cd2e4-15eb-4769-9a15-160826c0ef30 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:31.895225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-c71cd2e4-15eb-4769-9a15-160826c0ef30 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] HTTP exception thrown: Instance d7e25852-2606-4138-b039-56a9ed0b7f1e could not be found. Aug 19 21:18:31.896727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-c71cd2e4-15eb-4769-9a15-160826c0ef30 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Request method failure captured: Aug 19 21:18:31.896727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e HTTP/1.1 Aug 19 21:18:31.896727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:18:31.896727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:18:31.896727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:18:31.896727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:18:31.896727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:18:31.896727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:18:31.896727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:18:31.896727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:18:31.896727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__vd26Cb0mXv7t9M5WFOOYHhu6_1HXA35W3ospma2g9U7sFDdcDTQIBuuoLDY5brtQJDBOpSgsAo54GXcjus4z5BsvW7cJ7smrx8rnFYGq_2bFs80-KKshEc83AxCejow5QNEXpsTZyIuhP6mkHnlceVP0v4B7UulMMVywTQ5WGeB4E Aug 19 21:18:31.896727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:18:31.896727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:18:31.896727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:18:31.896727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:18:31.896727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:18:31.896727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:18:31.896727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: def1895e8f3b40f1b608240c60a0066a Aug 19 21:18:31.896727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-AttachVolumeTestJSON-66626407 Aug 19 21:18:31.896727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:18:31.896727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:18:31.898488 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/def1895e8f3b40f1b608240c60a0066a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/def1895e8f3b40f1b608240c60a0066a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_def1895e8f3b40f1b608240c60a0066a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/def1895e8f3b40f1b608240c60a0066a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:18:31.898488 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-AttachVolumeTestJSON-66626407 Aug 19 21:18:31.898488 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: def1895e8f3b40f1b608240c60a0066a Aug 19 21:18:31.898488 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-AttachVolumeTestJSON-66626407 Aug 19 21:18:31.898488 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-AttachVolumeTestJSON-66626407-project Aug 19 21:18:31.898488 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:18:31.898488 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:18:31.898488 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: 8810b3e211d448cea9a506d9183dc13d Aug 19 21:18:31.898488 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-AttachVolumeTestJSON-66626407-project Aug 19 21:18:31.898488 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: > Aug 19 21:18:31.898488 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Instance d7e25852-2606-4138-b039-56a9ed0b7f1e could not be found. Aug 19 21:18:31.898488 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': 'd7e25852-2606-4138-b039-56a9ed0b7f1e'} Aug 19 21:18:31.899381 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:18:31.899381 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:18:31.899381 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:18:31.899381 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:18:31.899381 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:18:31.899381 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:18:31.899381 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:18:31.899381 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:18:31.899381 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:18:31.899381 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:18:31.899381 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e25852-2606-4138-b039-56a9ed0b7f1e could not be found. Aug 19 21:18:31.899381 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:18:31.899381 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:18:31.899381 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:18:31.899381 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:18:31.899381 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:18:31.899381 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:18:31.899381 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:18:31.899381 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:18:31.899381 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:18:31.900878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:18:31.900878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:18:31.900878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:18:31.900878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:18:31.900878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:18:31.900878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:18:31.900878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:18:31.900878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e25852-2606-4138-b039-56a9ed0b7f1e could not be found. Aug 19 21:18:31.900878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:18:31.900878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:18:31.900878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:18:31.900878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:18:31.900878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:18:31.900878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:18:31.900878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:18:31.900878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:18:31.900878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e25852-2606-4138-b039-56a9ed0b7f1e could not be found. Aug 19 21:18:31.900878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:18:31.902233 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-c71cd2e4-15eb-4769-9a15-160826c0ef30 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] Returning 404 to user: Instance d7e25852-2606-4138-b039-56a9ed0b7f1e could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:18:31.902233 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-c71cd2e4-15eb-4769-9a15-160826c0ef30 tempest-AttachVolumeTestJSON-66626407 tempest-AttachVolumeTestJSON-66626407-project] 10.222.0.16 "GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e" status: 404 len: 111 microversion: 2.1 time: 0.031245 Aug 19 21:18:31.902233 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 418/910] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:18:31 2022] GET /compute/v2.1/servers/d7e25852-2606-4138-b039-56a9ed0b7f1e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:18:50.080202 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-496cef85-30e4-4833-b2d3-f94c9bebb37e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:18:50.080740 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-496cef85-30e4-4833-b2d3-f94c9bebb37e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:50.083014 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=35 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:18:50.083664 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=2 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:18:50.090585 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-496cef85-30e4-4833-b2d3-f94c9bebb37e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:50.091078 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-496cef85-30e4-4833-b2d3-f94c9bebb37e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:50.091516 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-496cef85-30e4-4833-b2d3-f94c9bebb37e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:50.092220 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-496cef85-30e4-4833-b2d3-f94c9bebb37e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:50.092673 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-496cef85-30e4-4833-b2d3-f94c9bebb37e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:50.093100 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-496cef85-30e4-4833-b2d3-f94c9bebb37e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:50.119097 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-496cef85-30e4-4833-b2d3-f94c9bebb37e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5/ips" status: 200 len: 149 microversion: 2.1 time: 0.042531 Aug 19 21:18:50.119667 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 493/911] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Aug 19 21:18:50 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:18:51.460819 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-24bfedfd-dd4e-423e-8df0-cb7ad413039e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5771642f-11e8-4c70-990b-601144b9c6eb"}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:18:51.463158 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-24bfedfd-dd4e-423e-8df0-cb7ad413039e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:18:51.466370 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:18:51.467025 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:18:51.473219 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-24bfedfd-dd4e-423e-8df0-cb7ad413039e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:51.473724 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-24bfedfd-dd4e-423e-8df0-cb7ad413039e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:51.474187 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-24bfedfd-dd4e-423e-8df0-cb7ad413039e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:51.474889 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-24bfedfd-dd4e-423e-8df0-cb7ad413039e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:18:51.475345 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-24bfedfd-dd4e-423e-8df0-cb7ad413039e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:18:51.475807 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-24bfedfd-dd4e-423e-8df0-cb7ad413039e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:18:51.742759 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-24bfedfd-dd4e-423e-8df0-cb7ad413039e tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "POST /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285805 Aug 19 21:18:51.743429 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 419/912] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Aug 19 21:18:51 2022] POST /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:19:02.591071 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8d8243f2-0275-47e6-80f0-eccd41a94cf9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:02.591633 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8d8243f2-0275-47e6-80f0-eccd41a94cf9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:02.594378 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=2 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:19:02.595094 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=4 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:19:02.601311 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8d8243f2-0275-47e6-80f0-eccd41a94cf9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:02.601843 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8d8243f2-0275-47e6-80f0-eccd41a94cf9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:02.602319 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8d8243f2-0275-47e6-80f0-eccd41a94cf9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:02.602974 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8d8243f2-0275-47e6-80f0-eccd41a94cf9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:02.603625 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8d8243f2-0275-47e6-80f0-eccd41a94cf9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:02.604052 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8d8243f2-0275-47e6-80f0-eccd41a94cf9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:02.688490 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.objects.instance [None req-8d8243f2-0275-47e6-80f0-eccd41a94cf9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lazy-loading 'services' on Instance uuid c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 {{(pid=120877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:19:02.765049 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8d8243f2-0275-47e6-80f0-eccd41a94cf9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5/os-volume_attachments/5771642f-11e8-4c70-990b-601144b9c6eb" status: 202 len: 0 microversion: 2.1 time: 0.177850 Aug 19 21:19:02.766313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 494/913] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Aug 19 21:19:02 2022] DELETE /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5/os-volume_attachments/5771642f-11e8-4c70-990b-601144b9c6eb => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:19:02.772455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=2 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:19:02.773223 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:19:02.778523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-8f2b05c2-ac0f-48cd-92e2-e851fd331e50 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:02.780908 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-8f2b05c2-ac0f-48cd-92e2-e851fd331e50 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:02.789484 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8f2b05c2-ac0f-48cd-92e2-e851fd331e50 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:02.790004 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8f2b05c2-ac0f-48cd-92e2-e851fd331e50 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:02.790436 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8f2b05c2-ac0f-48cd-92e2-e851fd331e50 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:02.791139 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8f2b05c2-ac0f-48cd-92e2-e851fd331e50 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:02.791587 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8f2b05c2-ac0f-48cd-92e2-e851fd331e50 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:02.792200 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8f2b05c2-ac0f-48cd-92e2-e851fd331e50 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:02.825325 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-8f2b05c2-ac0f-48cd-92e2-e851fd331e50 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054161 Aug 19 21:19:02.825904 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 420/914] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Aug 19 21:19:02 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:19:03.838597 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-86ebde61-4d8d-4be5-9e4b-26242193fb96 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:03.841898 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-86ebde61-4d8d-4be5-9e4b-26242193fb96 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:03.848623 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-86ebde61-4d8d-4be5-9e4b-26242193fb96 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:03.849105 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-86ebde61-4d8d-4be5-9e4b-26242193fb96 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:03.849535 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-86ebde61-4d8d-4be5-9e4b-26242193fb96 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:03.850259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-86ebde61-4d8d-4be5-9e4b-26242193fb96 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:03.850712 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-86ebde61-4d8d-4be5-9e4b-26242193fb96 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:03.851132 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-86ebde61-4d8d-4be5-9e4b-26242193fb96 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:03.880726 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-86ebde61-4d8d-4be5-9e4b-26242193fb96 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046504 Aug 19 21:19:03.881272 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 495/915] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Aug 19 21:19:03 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:19:04.894165 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-2c0e9903-791b-4362-ad20-934be9082e7d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:04.896221 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-2c0e9903-791b-4362-ad20-934be9082e7d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:04.903257 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2c0e9903-791b-4362-ad20-934be9082e7d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:04.903730 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2c0e9903-791b-4362-ad20-934be9082e7d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:04.904154 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2c0e9903-791b-4362-ad20-934be9082e7d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:04.904836 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2c0e9903-791b-4362-ad20-934be9082e7d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:04.905282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2c0e9903-791b-4362-ad20-934be9082e7d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:04.905698 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2c0e9903-791b-4362-ad20-934be9082e7d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:04.934566 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-2c0e9903-791b-4362-ad20-934be9082e7d tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044770 Aug 19 21:19:04.935107 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 421/916] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Aug 19 21:19:04 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:19:05.946728 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-9ae7a05e-f9e5-4003-9a6e-439c2b1236f3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:05.948882 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-9ae7a05e-f9e5-4003-9a6e-439c2b1236f3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:05.955231 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9ae7a05e-f9e5-4003-9a6e-439c2b1236f3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:05.955718 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9ae7a05e-f9e5-4003-9a6e-439c2b1236f3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:05.956163 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9ae7a05e-f9e5-4003-9a6e-439c2b1236f3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:05.956833 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9ae7a05e-f9e5-4003-9a6e-439c2b1236f3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:05.957281 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9ae7a05e-f9e5-4003-9a6e-439c2b1236f3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:05.957698 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9ae7a05e-f9e5-4003-9a6e-439c2b1236f3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:05.989008 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-9ae7a05e-f9e5-4003-9a6e-439c2b1236f3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045999 Aug 19 21:19:05.989912 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 496/917] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Aug 19 21:19:05 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:19:07.004107 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-21e74d2d-16da-412b-a7a1-12c808ebbad3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:07.006726 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-21e74d2d-16da-412b-a7a1-12c808ebbad3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:07.014233 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-21e74d2d-16da-412b-a7a1-12c808ebbad3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:07.014724 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-21e74d2d-16da-412b-a7a1-12c808ebbad3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:07.015165 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-21e74d2d-16da-412b-a7a1-12c808ebbad3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:07.016133 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-21e74d2d-16da-412b-a7a1-12c808ebbad3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:07.016588 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-21e74d2d-16da-412b-a7a1-12c808ebbad3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:07.017008 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-21e74d2d-16da-412b-a7a1-12c808ebbad3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:07.048918 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-21e74d2d-16da-412b-a7a1-12c808ebbad3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049090 Aug 19 21:19:07.049487 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 422/918] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Aug 19 21:19:06 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:19:08.061316 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-49e3413b-efd8-4cc2-903e-d2700f1f7ca4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:08.063503 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-49e3413b-efd8-4cc2-903e-d2700f1f7ca4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:08.069953 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-49e3413b-efd8-4cc2-903e-d2700f1f7ca4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:08.070439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-49e3413b-efd8-4cc2-903e-d2700f1f7ca4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:08.070876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-49e3413b-efd8-4cc2-903e-d2700f1f7ca4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:08.071567 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-49e3413b-efd8-4cc2-903e-d2700f1f7ca4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:08.072024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-49e3413b-efd8-4cc2-903e-d2700f1f7ca4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:08.072456 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-49e3413b-efd8-4cc2-903e-d2700f1f7ca4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:08.103343 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-49e3413b-efd8-4cc2-903e-d2700f1f7ca4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046527 Aug 19 21:19:08.103909 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 497/919] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Aug 19 21:19:08 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 21:19:08.168203 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-5be71bb6-262b-4e37-9e02-8129c40d3196 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:08.168758 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-5be71bb6-262b-4e37-9e02-8129c40d3196 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:08.175095 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5be71bb6-262b-4e37-9e02-8129c40d3196 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:08.175579 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5be71bb6-262b-4e37-9e02-8129c40d3196 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:08.176016 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5be71bb6-262b-4e37-9e02-8129c40d3196 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:08.176701 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5be71bb6-262b-4e37-9e02-8129c40d3196 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:08.177154 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5be71bb6-262b-4e37-9e02-8129c40d3196 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:08.177576 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5be71bb6-262b-4e37-9e02-8129c40d3196 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:08.204833 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-5be71bb6-262b-4e37-9e02-8129c40d3196 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Going to try to terminate instance {{(pid=120876) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 21:19:08.281795 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-5be71bb6-262b-4e37-9e02-8129c40d3196 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5" status: 204 len: 0 microversion: 2.1 time: 0.117194 Aug 19 21:19:08.282614 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 423/920] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:19:08 2022] DELETE /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 21:19:08.290653 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-68f65f9c-4b03-4760-9743-b623e3535a01 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:08.291261 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-68f65f9c-4b03-4760-9743-b623e3535a01 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:08.297793 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-68f65f9c-4b03-4760-9743-b623e3535a01 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:08.298318 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-68f65f9c-4b03-4760-9743-b623e3535a01 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:08.298747 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-68f65f9c-4b03-4760-9743-b623e3535a01 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:08.299434 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-68f65f9c-4b03-4760-9743-b623e3535a01 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:08.299882 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-68f65f9c-4b03-4760-9743-b623e3535a01 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:08.300307 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-68f65f9c-4b03-4760-9743-b623e3535a01 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:08.430020 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-68f65f9c-4b03-4760-9743-b623e3535a01 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:08.438479 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-68f65f9c-4b03-4760-9743-b623e3535a01 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5" status: 200 len: 1681 microversion: 2.1 time: 0.151695 Aug 19 21:19:08.439041 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 498/921] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:08 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:09.460895 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-0108d740-02b4-4b4d-8385-2d1036c553b4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:09.461590 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-0108d740-02b4-4b4d-8385-2d1036c553b4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:09.468735 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0108d740-02b4-4b4d-8385-2d1036c553b4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:09.469214 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0108d740-02b4-4b4d-8385-2d1036c553b4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:09.469639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0108d740-02b4-4b4d-8385-2d1036c553b4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:09.470348 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0108d740-02b4-4b4d-8385-2d1036c553b4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:09.470794 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0108d740-02b4-4b4d-8385-2d1036c553b4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:09.471209 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-0108d740-02b4-4b4d-8385-2d1036c553b4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:09.600011 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-0108d740-02b4-4b4d-8385-2d1036c553b4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:09.608676 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-0108d740-02b4-4b4d-8385-2d1036c553b4 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5" status: 200 len: 1681 microversion: 2.1 time: 0.152053 Aug 19 21:19:09.609249 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 424/922] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:09 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:10.630680 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8c684b44-e216-4dd9-8f6e-86fa984ef0a3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:10.631285 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8c684b44-e216-4dd9-8f6e-86fa984ef0a3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:10.638501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c684b44-e216-4dd9-8f6e-86fa984ef0a3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:10.638982 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c684b44-e216-4dd9-8f6e-86fa984ef0a3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:10.639415 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c684b44-e216-4dd9-8f6e-86fa984ef0a3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:10.640099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c684b44-e216-4dd9-8f6e-86fa984ef0a3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:10.640549 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c684b44-e216-4dd9-8f6e-86fa984ef0a3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:10.641223 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8c684b44-e216-4dd9-8f6e-86fa984ef0a3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:10.775764 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8c684b44-e216-4dd9-8f6e-86fa984ef0a3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:10.784355 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8c684b44-e216-4dd9-8f6e-86fa984ef0a3 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5" status: 200 len: 1681 microversion: 2.1 time: 0.157621 Aug 19 21:19:10.784924 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 499/923] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:10 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:11.805686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-b73be2e7-01b2-4f61-8e17-1f88d89c9b53 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:11.806331 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-b73be2e7-01b2-4f61-8e17-1f88d89c9b53 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:11.813621 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b73be2e7-01b2-4f61-8e17-1f88d89c9b53 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:11.814140 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b73be2e7-01b2-4f61-8e17-1f88d89c9b53 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:11.814570 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b73be2e7-01b2-4f61-8e17-1f88d89c9b53 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:11.815276 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b73be2e7-01b2-4f61-8e17-1f88d89c9b53 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:11.815764 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b73be2e7-01b2-4f61-8e17-1f88d89c9b53 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:11.816217 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b73be2e7-01b2-4f61-8e17-1f88d89c9b53 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:11.948718 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b73be2e7-01b2-4f61-8e17-1f88d89c9b53 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:11.956496 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-b73be2e7-01b2-4f61-8e17-1f88d89c9b53 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5" status: 200 len: 1681 microversion: 2.1 time: 0.154712 Aug 19 21:19:11.957069 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 425/924] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:11 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:12.979056 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-d198dcae-0c17-49ea-8374-df7a4774e8fd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:12.979728 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-d198dcae-0c17-49ea-8374-df7a4774e8fd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:12.986071 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d198dcae-0c17-49ea-8374-df7a4774e8fd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:12.986562 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d198dcae-0c17-49ea-8374-df7a4774e8fd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:12.987004 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d198dcae-0c17-49ea-8374-df7a4774e8fd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:12.987707 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d198dcae-0c17-49ea-8374-df7a4774e8fd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:12.988167 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d198dcae-0c17-49ea-8374-df7a4774e8fd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:12.988593 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d198dcae-0c17-49ea-8374-df7a4774e8fd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:13.131838 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-d198dcae-0c17-49ea-8374-df7a4774e8fd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:13.144659 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-d198dcae-0c17-49ea-8374-df7a4774e8fd tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5" status: 200 len: 1681 microversion: 2.1 time: 0.169468 Aug 19 21:19:13.145992 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 500/925] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:12 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:14.167388 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-7a65f52d-1309-4d0f-9414-67e43fa9aa1c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:14.168856 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-7a65f52d-1309-4d0f-9414-67e43fa9aa1c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:14.178568 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7a65f52d-1309-4d0f-9414-67e43fa9aa1c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:14.181943 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7a65f52d-1309-4d0f-9414-67e43fa9aa1c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:14.182458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7a65f52d-1309-4d0f-9414-67e43fa9aa1c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:14.189583 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7a65f52d-1309-4d0f-9414-67e43fa9aa1c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:14.190444 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7a65f52d-1309-4d0f-9414-67e43fa9aa1c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:14.190786 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7a65f52d-1309-4d0f-9414-67e43fa9aa1c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:14.220676 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-c20a090f-0c4e-447d-a956-6609fabf5bc3 req-f4dfdd38-46c0-48fd-918a-cc559c0d2e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5", "name": "network-vif-deleted", "tag": "6ee9f12c-0d63-4bb1-9c4a-9f1b917fc468"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:19:14.232364 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-c20a090f-0c4e-447d-a956-6609fabf5bc3 req-f4dfdd38-46c0-48fd-918a-cc559c0d2e3d service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:14.232997 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-c20a090f-0c4e-447d-a956-6609fabf5bc3 req-f4dfdd38-46c0-48fd-918a-cc559c0d2e3d service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:14.233589 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-c20a090f-0c4e-447d-a956-6609fabf5bc3 req-f4dfdd38-46c0-48fd-918a-cc559c0d2e3d service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:14.239481 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7a65f52d-1309-4d0f-9414-67e43fa9aa1c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:14.240072 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7a65f52d-1309-4d0f-9414-67e43fa9aa1c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:14.240534 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7a65f52d-1309-4d0f-9414-67e43fa9aa1c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:14.240998 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.objects.instance [None req-7a65f52d-1309-4d0f-9414-67e43fa9aa1c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lazy-loading 'fault' on Instance uuid c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 {{(pid=120877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:19:14.249749 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-c20a090f-0c4e-447d-a956-6609fabf5bc3 req-f4dfdd38-46c0-48fd-918a-cc559c0d2e3d service nova] Creating event network-vif-deleted:6ee9f12c-0d63-4bb1-9c4a-9f1b917fc468 for instance c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 on hv-cinder-85220 Aug 19 21:19:14.256929 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-c20a090f-0c4e-447d-a956-6609fabf5bc3 req-f4dfdd38-46c0-48fd-918a-cc559c0d2e3d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214358 Aug 19 21:19:14.257924 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 426/926] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:19:14.285699 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-7a65f52d-1309-4d0f-9414-67e43fa9aa1c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f46019e78cc4e89bf877a4f5a7a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358e50f9b9df43b7aa0a4ba1353e4a25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:14.294576 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-7a65f52d-1309-4d0f-9414-67e43fa9aa1c tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5" status: 200 len: 1332 microversion: 2.1 time: 0.130933 Aug 19 21:19:14.295427 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 501/927] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:14 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 => generated 1332 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:15.316547 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-f341e454-2843-42c1-b066-165b3e05ef61 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:15.317240 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-f341e454-2843-42c1-b066-165b3e05ef61 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:15.323898 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f341e454-2843-42c1-b066-165b3e05ef61 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:15.325477 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f341e454-2843-42c1-b066-165b3e05ef61 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:15.326267 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f341e454-2843-42c1-b066-165b3e05ef61 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:15.326958 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f341e454-2843-42c1-b066-165b3e05ef61 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:15.327406 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f341e454-2843-42c1-b066-165b3e05ef61 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:15.327822 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f341e454-2843-42c1-b066-165b3e05ef61 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:15.341917 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-f341e454-2843-42c1-b066-165b3e05ef61 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] HTTP exception thrown: Instance c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 could not be found. Aug 19 21:19:15.343523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-f341e454-2843-42c1-b066-165b3e05ef61 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Request method failure captured: Aug 19 21:19:15.343523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 HTTP/1.1 Aug 19 21:19:15.343523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:19:15.343523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:19:15.343523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:19:15.343523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:19:15.343523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:19:15.343523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:19:15.343523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:19:15.343523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:19:15.343523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__vTnxy0ZuRvCXYQHvdPUOIQ6IB7Tloqeiky5Yoiyt0Vgpb02m5mw3a2DEvQ0XyB7szWj5fdMvWapGqmCGDv7CfrB3Py-zgdnjUuiEJx19vEpXywPa2SVjntZLwoFOFk2XhitOUTwaBJ37dbyUmN2puMJZysaOLWl8Nrh88xp2dULAg Aug 19 21:19:15.343523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:19:15.343523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:19:15.343523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:19:15.343523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:19:15.343523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:19:15.343523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:19:15.343523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:19:15.343523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:15.343523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:19:15.343523 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:19:15.345181 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:19:15.345181 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:15.345181 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:19:15.345181 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:15.345181 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:19:15.345181 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:19:15.345181 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:19:15.345181 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: 7f46019e78cc4e89bf877a4f5a7a8fe9 Aug 19 21:19:15.345181 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:19:15.345181 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: > Aug 19 21:19:15.345181 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Instance c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 could not be found. Aug 19 21:19:15.345181 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': 'c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5'} Aug 19 21:19:15.346164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:19:15.346164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:15.346164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:19:15.346164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:19:15.346164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:19:15.346164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:19:15.346164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:19:15.346164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:19:15.346164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:19:15.346164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:19:15.346164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 could not be found. Aug 19 21:19:15.346164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:15.346164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:15.346164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:15.346164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:15.346164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:15.346164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:15.346164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:19:15.346164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:19:15.346164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:19:15.347735 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:19:15.347735 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:19:15.347735 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:19:15.347735 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:19:15.347735 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:19:15.347735 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:19:15.347735 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:19:15.347735 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 could not be found. Aug 19 21:19:15.347735 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:15.347735 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:15.347735 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:15.347735 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:15.347735 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:15.347735 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:15.347735 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:19:15.347735 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:19:15.347735 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 could not be found. Aug 19 21:19:15.347735 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:15.349244 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-f341e454-2843-42c1-b066-165b3e05ef61 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Returning 404 to user: Instance c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:19:15.349244 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-f341e454-2843-42c1-b066-165b3e05ef61 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5" status: 404 len: 111 microversion: 2.1 time: 0.032605 Aug 19 21:19:15.349244 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 427/928] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:15 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:19:15.353685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-70eeb09c-7160-4ddb-b0b4-56fc798a24ac tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '.version_select at 0x7f740bbaeaf0>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:15.374031 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-70eeb09c-7160-4ddb-b0b4-56fc798a24ac tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544952583" status: 202 len: 0 microversion: 2.1 time: 0.024051 Aug 19 21:19:15.374592 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 502/929] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Aug 19 21:19:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544952583 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:19:17.148002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-84a94832-51ef-4176-88ac-7ecaabc8ff6b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:17.148560 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-84a94832-51ef-4176-88ac-7ecaabc8ff6b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:17.155387 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-84a94832-51ef-4176-88ac-7ecaabc8ff6b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:17.155877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-84a94832-51ef-4176-88ac-7ecaabc8ff6b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:17.156305 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-84a94832-51ef-4176-88ac-7ecaabc8ff6b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:17.157038 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-84a94832-51ef-4176-88ac-7ecaabc8ff6b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:17.157486 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-84a94832-51ef-4176-88ac-7ecaabc8ff6b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:17.157936 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-84a94832-51ef-4176-88ac-7ecaabc8ff6b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:17.172147 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-84a94832-51ef-4176-88ac-7ecaabc8ff6b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] HTTP exception thrown: Instance c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 could not be found. Aug 19 21:19:17.173630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-84a94832-51ef-4176-88ac-7ecaabc8ff6b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Request method failure captured: Aug 19 21:19:17.173630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: DELETE /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 HTTP/1.1 Aug 19 21:19:17.173630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:19:17.173630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:19:17.173630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:19:17.173630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:19:17.173630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:19:17.173630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:19:17.173630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:19:17.173630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:19:17.173630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__vTnxy0ZuRvCXYQHvdPUOIQ6IB7Tloqeiky5Yoiyt0Vgpb02m5mw3a2DEvQ0XyB7szWj5fdMvWapGqmCGDv7CfrB3Py-zgdnjUuiEJx19vEpXywPa2SVjntZLwoFOFk2XhitOUTwaBJ37dbyUmN2puMJZysaOLWl8Nrh88xp2dULAg Aug 19 21:19:17.173630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:19:17.173630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:19:17.173630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:19:17.173630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:19:17.173630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:19:17.173630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:19:17.173630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:19:17.173630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:17.173630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:19:17.173630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:19:17.175362 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:19:17.175362 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:17.175362 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:19:17.175362 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:17.175362 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:19:17.175362 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:19:17.175362 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:19:17.175362 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: 7f46019e78cc4e89bf877a4f5a7a8fe9 Aug 19 21:19:17.175362 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:19:17.175362 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: > Aug 19 21:19:17.175362 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Instance c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 could not be found. Aug 19 21:19:17.175362 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': 'c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5'} Aug 19 21:19:17.176563 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:19:17.176563 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:17.176563 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:19:17.176563 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:19:17.176563 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:19:17.176563 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:19:17.176563 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:19:17.176563 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:19:17.176563 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:19:17.176563 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:19:17.176563 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 could not be found. Aug 19 21:19:17.176563 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:17.176563 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:17.176563 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:17.176563 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:17.176563 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:17.176563 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:17.176563 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:19:17.176563 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:19:17.176563 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:19:17.178234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:19:17.178234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 21:19:17.178234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 21:19:17.178234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 21:19:17.178234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 21:19:17.178234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:19:17.178234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:19:17.178234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:19:17.178234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:19:17.178234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 could not be found. Aug 19 21:19:17.178234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:17.178234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:17.178234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:17.178234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:17.178234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:17.178234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:17.178234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:19:17.178234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:19:17.178234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 could not be found. Aug 19 21:19:17.178234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:17.179902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-84a94832-51ef-4176-88ac-7ecaabc8ff6b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Returning 404 to user: Instance c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:19:17.179902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-84a94832-51ef-4176-88ac-7ecaabc8ff6b tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5" status: 404 len: 111 microversion: 2.1 time: 0.031058 Aug 19 21:19:17.179902 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 428/930] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:19:17 2022] DELETE /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:19:17.187500 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-66329e0e-0af2-417f-9d8b-2e6602b8a867 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:17.188652 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-66329e0e-0af2-417f-9d8b-2e6602b8a867 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:17.196954 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-66329e0e-0af2-417f-9d8b-2e6602b8a867 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:17.197447 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-66329e0e-0af2-417f-9d8b-2e6602b8a867 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:17.197911 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-66329e0e-0af2-417f-9d8b-2e6602b8a867 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:17.199063 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-66329e0e-0af2-417f-9d8b-2e6602b8a867 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:17.199766 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-66329e0e-0af2-417f-9d8b-2e6602b8a867 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:17.200095 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-66329e0e-0af2-417f-9d8b-2e6602b8a867 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:17.214847 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-66329e0e-0af2-417f-9d8b-2e6602b8a867 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] HTTP exception thrown: Instance c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 could not be found. Aug 19 21:19:17.216537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-66329e0e-0af2-417f-9d8b-2e6602b8a867 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Request method failure captured: Aug 19 21:19:17.216537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 HTTP/1.1 Aug 19 21:19:17.216537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:19:17.216537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:19:17.216537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:19:17.216537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:19:17.216537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:19:17.216537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:19:17.216537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:19:17.216537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:19:17.216537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__vTnxy0ZuRvCXYQHvdPUOIQ6IB7Tloqeiky5Yoiyt0Vgpb02m5mw3a2DEvQ0XyB7szWj5fdMvWapGqmCGDv7CfrB3Py-zgdnjUuiEJx19vEpXywPa2SVjntZLwoFOFk2XhitOUTwaBJ37dbyUmN2puMJZysaOLWl8Nrh88xp2dULAg Aug 19 21:19:17.216537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:19:17.216537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:19:17.216537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:19:17.216537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:19:17.216537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:19:17.216537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:19:17.216537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:19:17.216537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:17.216537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:19:17.216537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:19:17.219214 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:19:17.219214 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:17.219214 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:19:17.219214 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:17.219214 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:19:17.219214 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:19:17.219214 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:19:17.219214 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: 7f46019e78cc4e89bf877a4f5a7a8fe9 Aug 19 21:19:17.219214 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:19:17.219214 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: > Aug 19 21:19:17.219214 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Instance c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 could not be found. Aug 19 21:19:17.219214 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'id': 'c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5'} Aug 19 21:19:17.221993 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:19:17.221993 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:17.221993 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:19:17.221993 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:19:17.221993 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:19:17.221993 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:19:17.221993 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:19:17.221993 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:19:17.221993 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:19:17.221993 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:19:17.221993 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 could not be found. Aug 19 21:19:17.221993 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:17.221993 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:17.221993 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:17.221993 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:17.221993 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:17.221993 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:17.221993 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:19:17.221993 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:19:17.221993 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:19:17.224834 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:19:17.224834 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:19:17.224834 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:19:17.224834 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:19:17.224834 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:19:17.224834 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:19:17.224834 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:19:17.224834 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 could not be found. Aug 19 21:19:17.224834 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:17.224834 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:17.224834 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:17.224834 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:17.224834 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:17.224834 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:17.224834 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:19:17.224834 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:19:17.224834 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 could not be found. Aug 19 21:19:17.224834 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:17.227421 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-66329e0e-0af2-417f-9d8b-2e6602b8a867 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Returning 404 to user: Instance c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:19:17.227421 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-66329e0e-0af2-417f-9d8b-2e6602b8a867 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5" status: 404 len: 111 microversion: 2.1 time: 0.035347 Aug 19 21:19:17.227421 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 503/931] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:17 2022] GET /compute/v2.1/servers/c5824a5c-44c2-48ee-ba54-4bc1cbb20ed5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:19:18.372817 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d89101ef-dac5-404a-912b-ec09478cc8a9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:18.373545 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-d89101ef-dac5-404a-912b-ec09478cc8a9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:18.380616 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d89101ef-dac5-404a-912b-ec09478cc8a9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:18.381224 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d89101ef-dac5-404a-912b-ec09478cc8a9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:18.381639 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d89101ef-dac5-404a-912b-ec09478cc8a9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:18.382375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d89101ef-dac5-404a-912b-ec09478cc8a9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:18.382832 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d89101ef-dac5-404a-912b-ec09478cc8a9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:18.383256 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d89101ef-dac5-404a-912b-ec09478cc8a9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:18.397506 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-d89101ef-dac5-404a-912b-ec09478cc8a9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] HTTP exception thrown: Instance 26867181-b826-417c-a967-774b70a8d82f could not be found. Aug 19 21:19:18.399093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d89101ef-dac5-404a-912b-ec09478cc8a9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Request method failure captured: Aug 19 21:19:18.399093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: DELETE /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f HTTP/1.1 Aug 19 21:19:18.399093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:19:18.399093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:19:18.399093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:19:18.399093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:19:18.399093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:19:18.399093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:19:18.399093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:19:18.399093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:19:18.399093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__vTnxy0ZuRvCXYQHvdPUOIQ6IB7Tloqeiky5Yoiyt0Vgpb02m5mw3a2DEvQ0XyB7szWj5fdMvWapGqmCGDv7CfrB3Py-zgdnjUuiEJx19vEpXywPa2SVjntZLwoFOFk2XhitOUTwaBJ37dbyUmN2puMJZysaOLWl8Nrh88xp2dULAg Aug 19 21:19:18.399093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:19:18.399093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:19:18.399093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:19:18.399093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:19:18.399093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:19:18.399093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:19:18.399093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:19:18.399093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:18.399093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:19:18.399093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:19:18.400665 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:19:18.400665 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:18.400665 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:19:18.400665 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:18.400665 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:19:18.400665 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:19:18.400665 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:19:18.400665 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: 7f46019e78cc4e89bf877a4f5a7a8fe9 Aug 19 21:19:18.400665 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:19:18.400665 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: > Aug 19 21:19:18.400665 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Instance 26867181-b826-417c-a967-774b70a8d82f could not be found. Aug 19 21:19:18.400665 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': '26867181-b826-417c-a967-774b70a8d82f'} Aug 19 21:19:18.401716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:19:18.401716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:18.401716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:19:18.401716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:19:18.401716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:19:18.401716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:19:18.401716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:19:18.401716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:19:18.401716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:19:18.401716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:19:18.401716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26867181-b826-417c-a967-774b70a8d82f could not be found. Aug 19 21:19:18.401716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:18.401716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:18.401716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:18.401716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:18.401716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:18.401716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:18.401716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:19:18.401716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:19:18.401716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:19:18.403375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:19:18.403375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 21:19:18.403375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 21:19:18.403375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 21:19:18.403375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 21:19:18.403375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:19:18.403375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:19:18.403375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:19:18.403375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:19:18.403375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26867181-b826-417c-a967-774b70a8d82f could not be found. Aug 19 21:19:18.403375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:18.403375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:18.403375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:18.403375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:18.403375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:18.403375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:18.403375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:19:18.403375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:19:18.403375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26867181-b826-417c-a967-774b70a8d82f could not be found. Aug 19 21:19:18.403375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:18.405174 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d89101ef-dac5-404a-912b-ec09478cc8a9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Returning 404 to user: Instance 26867181-b826-417c-a967-774b70a8d82f could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:19:18.405174 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-d89101ef-dac5-404a-912b-ec09478cc8a9 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "DELETE /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f" status: 404 len: 111 microversion: 2.1 time: 0.032519 Aug 19 21:19:18.405174 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 429/932] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:19:18 2022] DELETE /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:19:18.410029 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-018cfa95-f8a5-4990-b4e3-1b1c14c59e3f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:18.410859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-018cfa95-f8a5-4990-b4e3-1b1c14c59e3f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 26867181-b826-417c-a967-774b70a8d82f] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:18.417437 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-018cfa95-f8a5-4990-b4e3-1b1c14c59e3f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:18.418501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-018cfa95-f8a5-4990-b4e3-1b1c14c59e3f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:18.418949 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-018cfa95-f8a5-4990-b4e3-1b1c14c59e3f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:18.419651 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-018cfa95-f8a5-4990-b4e3-1b1c14c59e3f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:18.420114 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-018cfa95-f8a5-4990-b4e3-1b1c14c59e3f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:18.420544 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-018cfa95-f8a5-4990-b4e3-1b1c14c59e3f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:18.435071 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-018cfa95-f8a5-4990-b4e3-1b1c14c59e3f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] HTTP exception thrown: Instance 26867181-b826-417c-a967-774b70a8d82f could not be found. Aug 19 21:19:18.436778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-018cfa95-f8a5-4990-b4e3-1b1c14c59e3f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Request method failure captured: Aug 19 21:19:18.436778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f HTTP/1.1 Aug 19 21:19:18.436778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:19:18.436778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:19:18.436778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:19:18.436778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:19:18.436778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:19:18.436778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:19:18.436778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:19:18.436778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:19:18.436778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__vTnxy0ZuRvCXYQHvdPUOIQ6IB7Tloqeiky5Yoiyt0Vgpb02m5mw3a2DEvQ0XyB7szWj5fdMvWapGqmCGDv7CfrB3Py-zgdnjUuiEJx19vEpXywPa2SVjntZLwoFOFk2XhitOUTwaBJ37dbyUmN2puMJZysaOLWl8Nrh88xp2dULAg Aug 19 21:19:18.436778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:19:18.436778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:19:18.436778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:19:18.436778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:19:18.436778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:19:18.436778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:19:18.436778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:19:18.436778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:18.436778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:19:18.436778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:19:18.438446 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:19:18.438446 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:18.438446 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:19:18.438446 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:18.438446 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:19:18.438446 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:19:18.438446 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:19:18.438446 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: 7f46019e78cc4e89bf877a4f5a7a8fe9 Aug 19 21:19:18.438446 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:19:18.438446 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: > Aug 19 21:19:18.438446 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Instance 26867181-b826-417c-a967-774b70a8d82f could not be found. Aug 19 21:19:18.438446 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'id': '26867181-b826-417c-a967-774b70a8d82f'} Aug 19 21:19:18.439381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:19:18.439381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:18.439381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:19:18.439381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:19:18.439381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:19:18.439381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:19:18.439381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:19:18.439381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:19:18.439381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:19:18.439381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:19:18.439381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26867181-b826-417c-a967-774b70a8d82f could not be found. Aug 19 21:19:18.439381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:18.439381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:18.439381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:18.439381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:18.439381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:18.439381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:18.439381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:19:18.439381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:19:18.439381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:19:18.440611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:19:18.440611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:19:18.440611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:19:18.440611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:19:18.440611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:19:18.440611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:19:18.440611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:19:18.440611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26867181-b826-417c-a967-774b70a8d82f could not be found. Aug 19 21:19:18.440611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:18.440611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:18.440611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:18.440611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:18.440611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:18.440611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:18.440611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:19:18.440611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:19:18.440611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26867181-b826-417c-a967-774b70a8d82f could not be found. Aug 19 21:19:18.440611 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:18.442699 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-018cfa95-f8a5-4990-b4e3-1b1c14c59e3f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Returning 404 to user: Instance 26867181-b826-417c-a967-774b70a8d82f could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:19:18.442699 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-018cfa95-f8a5-4990-b4e3-1b1c14c59e3f tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f" status: 404 len: 111 microversion: 2.1 time: 0.032767 Aug 19 21:19:18.442699 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 504/933] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:18 2022] GET /compute/v2.1/servers/26867181-b826-417c-a967-774b70a8d82f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:19:18.447060 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-fa35eabe-96d8-43df-b031-762845835662 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:18.447548 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-fa35eabe-96d8-43df-b031-762845835662 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:18.460094 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fa35eabe-96d8-43df-b031-762845835662 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:18.460690 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fa35eabe-96d8-43df-b031-762845835662 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:18.461197 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fa35eabe-96d8-43df-b031-762845835662 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:18.462093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fa35eabe-96d8-43df-b031-762845835662 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:18.462730 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fa35eabe-96d8-43df-b031-762845835662 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:18.463221 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fa35eabe-96d8-43df-b031-762845835662 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:18.479072 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-fa35eabe-96d8-43df-b031-762845835662 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] HTTP exception thrown: Instance ee12fef4-cda2-4500-9975-002853bd4532 could not be found. Aug 19 21:19:18.481367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-fa35eabe-96d8-43df-b031-762845835662 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Request method failure captured: Aug 19 21:19:18.481367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: DELETE /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532 HTTP/1.1 Aug 19 21:19:18.481367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:19:18.481367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:19:18.481367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:19:18.481367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:19:18.481367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:19:18.481367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:19:18.481367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:19:18.481367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:19:18.481367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__vTnxy0ZuRvCXYQHvdPUOIQ6IB7Tloqeiky5Yoiyt0Vgpb02m5mw3a2DEvQ0XyB7szWj5fdMvWapGqmCGDv7CfrB3Py-zgdnjUuiEJx19vEpXywPa2SVjntZLwoFOFk2XhitOUTwaBJ37dbyUmN2puMJZysaOLWl8Nrh88xp2dULAg Aug 19 21:19:18.481367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:19:18.481367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:19:18.481367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:19:18.481367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:19:18.481367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:19:18.481367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:19:18.481367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:19:18.481367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:18.481367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:19:18.481367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:19:18.483116 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:19:18.483116 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:18.483116 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:19:18.483116 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:18.483116 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:19:18.483116 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:19:18.483116 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:19:18.483116 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: 7f46019e78cc4e89bf877a4f5a7a8fe9 Aug 19 21:19:18.483116 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:19:18.483116 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: > Aug 19 21:19:18.483116 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Instance ee12fef4-cda2-4500-9975-002853bd4532 could not be found. Aug 19 21:19:18.483116 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': 'ee12fef4-cda2-4500-9975-002853bd4532'} Aug 19 21:19:18.483900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:19:18.483900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:18.483900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:19:18.483900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:19:18.483900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:19:18.483900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:19:18.483900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:19:18.483900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:19:18.483900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:19:18.483900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:19:18.483900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee12fef4-cda2-4500-9975-002853bd4532 could not be found. Aug 19 21:19:18.483900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:18.483900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:18.483900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:18.483900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:18.483900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:18.483900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:18.483900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:19:18.483900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:19:18.483900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:19:18.485184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:19:18.485184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 21:19:18.485184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 21:19:18.485184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 21:19:18.485184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 21:19:18.485184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:19:18.485184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:19:18.485184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:19:18.485184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:19:18.485184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee12fef4-cda2-4500-9975-002853bd4532 could not be found. Aug 19 21:19:18.485184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:18.485184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:18.485184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:18.485184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:18.485184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:18.485184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:18.485184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:19:18.485184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:19:18.485184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee12fef4-cda2-4500-9975-002853bd4532 could not be found. Aug 19 21:19:18.485184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:18.486568 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-fa35eabe-96d8-43df-b031-762845835662 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Returning 404 to user: Instance ee12fef4-cda2-4500-9975-002853bd4532 could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:19:18.486568 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-fa35eabe-96d8-43df-b031-762845835662 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532" status: 404 len: 111 microversion: 2.1 time: 0.039512 Aug 19 21:19:18.486568 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 430/934] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:19:18 2022] DELETE /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:19:18.491519 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-58e81a06-3b1f-4001-8be6-fe1c49f42290 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:18.492130 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-58e81a06-3b1f-4001-8be6-fe1c49f42290 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: ee12fef4-cda2-4500-9975-002853bd4532] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:18.498364 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58e81a06-3b1f-4001-8be6-fe1c49f42290 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:18.498855 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58e81a06-3b1f-4001-8be6-fe1c49f42290 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:18.499296 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58e81a06-3b1f-4001-8be6-fe1c49f42290 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:18.500003 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58e81a06-3b1f-4001-8be6-fe1c49f42290 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:18.500462 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58e81a06-3b1f-4001-8be6-fe1c49f42290 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:18.500885 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58e81a06-3b1f-4001-8be6-fe1c49f42290 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:18.515519 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-58e81a06-3b1f-4001-8be6-fe1c49f42290 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] HTTP exception thrown: Instance ee12fef4-cda2-4500-9975-002853bd4532 could not be found. Aug 19 21:19:18.517439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-58e81a06-3b1f-4001-8be6-fe1c49f42290 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Request method failure captured: Aug 19 21:19:18.517439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532 HTTP/1.1 Aug 19 21:19:18.517439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:19:18.517439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:19:18.517439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:19:18.517439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:19:18.517439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:19:18.517439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:19:18.517439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:19:18.517439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:19:18.517439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__vTnxy0ZuRvCXYQHvdPUOIQ6IB7Tloqeiky5Yoiyt0Vgpb02m5mw3a2DEvQ0XyB7szWj5fdMvWapGqmCGDv7CfrB3Py-zgdnjUuiEJx19vEpXywPa2SVjntZLwoFOFk2XhitOUTwaBJ37dbyUmN2puMJZysaOLWl8Nrh88xp2dULAg Aug 19 21:19:18.517439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:19:18.517439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:19:18.517439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:19:18.517439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:19:18.517439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:19:18.517439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:19:18.517439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:19:18.517439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:18.517439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:19:18.517439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:19:18.519099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:19:18.519099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:18.519099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:19:18.519099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:18.519099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:19:18.519099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:19:18.519099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:19:18.519099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: 7f46019e78cc4e89bf877a4f5a7a8fe9 Aug 19 21:19:18.519099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:19:18.519099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: > Aug 19 21:19:18.519099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Instance ee12fef4-cda2-4500-9975-002853bd4532 could not be found. Aug 19 21:19:18.519099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'id': 'ee12fef4-cda2-4500-9975-002853bd4532'} Aug 19 21:19:18.520772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:19:18.520772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:18.520772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:19:18.520772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:19:18.520772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:19:18.520772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:19:18.520772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:19:18.520772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:19:18.520772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:19:18.520772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:19:18.520772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee12fef4-cda2-4500-9975-002853bd4532 could not be found. Aug 19 21:19:18.520772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:18.520772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:18.520772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:18.520772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:18.520772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:18.520772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:18.520772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:19:18.520772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:19:18.520772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:19:18.522395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:19:18.522395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:19:18.522395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:19:18.522395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:19:18.522395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:19:18.522395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:19:18.522395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:19:18.522395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee12fef4-cda2-4500-9975-002853bd4532 could not be found. Aug 19 21:19:18.522395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:18.522395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:18.522395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:18.522395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:18.522395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:18.522395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:18.522395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:19:18.522395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:19:18.522395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee12fef4-cda2-4500-9975-002853bd4532 could not be found. Aug 19 21:19:18.522395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:18.523745 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-58e81a06-3b1f-4001-8be6-fe1c49f42290 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Returning 404 to user: Instance ee12fef4-cda2-4500-9975-002853bd4532 could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:19:18.523745 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-58e81a06-3b1f-4001-8be6-fe1c49f42290 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532" status: 404 len: 111 microversion: 2.1 time: 0.031219 Aug 19 21:19:18.523745 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 505/935] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:18 2022] GET /compute/v2.1/servers/ee12fef4-cda2-4500-9975-002853bd4532 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:19:19.669164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-1956e4e8-d392-4407-89ab-ce2dac9f1a82 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:19.670407 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-1956e4e8-d392-4407-89ab-ce2dac9f1a82 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:19.679657 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1956e4e8-d392-4407-89ab-ce2dac9f1a82 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:19.680165 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1956e4e8-d392-4407-89ab-ce2dac9f1a82 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:19.680605 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1956e4e8-d392-4407-89ab-ce2dac9f1a82 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:19.681317 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1956e4e8-d392-4407-89ab-ce2dac9f1a82 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:19.681790 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1956e4e8-d392-4407-89ab-ce2dac9f1a82 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:19.682396 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1956e4e8-d392-4407-89ab-ce2dac9f1a82 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:19.700069 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-1956e4e8-d392-4407-89ab-ce2dac9f1a82 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] HTTP exception thrown: Instance 99339e5a-af6a-4d00-a02b-cec028b663ae could not be found. Aug 19 21:19:19.701791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-1956e4e8-d392-4407-89ab-ce2dac9f1a82 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Request method failure captured: Aug 19 21:19:19.701791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: DELETE /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae HTTP/1.1 Aug 19 21:19:19.701791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:19:19.701791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:19:19.701791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:19:19.701791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:19:19.701791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:19:19.701791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:19:19.701791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:19:19.701791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:19:19.701791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__vTnxy0ZuRvCXYQHvdPUOIQ6IB7Tloqeiky5Yoiyt0Vgpb02m5mw3a2DEvQ0XyB7szWj5fdMvWapGqmCGDv7CfrB3Py-zgdnjUuiEJx19vEpXywPa2SVjntZLwoFOFk2XhitOUTwaBJ37dbyUmN2puMJZysaOLWl8Nrh88xp2dULAg Aug 19 21:19:19.701791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:19:19.701791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:19:19.701791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:19:19.701791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:19:19.701791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:19:19.701791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:19:19.701791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:19:19.701791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:19.701791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:19:19.701791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:19:19.703437 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:19:19.703437 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:19.703437 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:19:19.703437 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:19.703437 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:19:19.703437 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:19:19.703437 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:19:19.703437 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: 7f46019e78cc4e89bf877a4f5a7a8fe9 Aug 19 21:19:19.703437 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:19:19.703437 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: > Aug 19 21:19:19.703437 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Instance 99339e5a-af6a-4d00-a02b-cec028b663ae could not be found. Aug 19 21:19:19.703437 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': '99339e5a-af6a-4d00-a02b-cec028b663ae'} Aug 19 21:19:19.704308 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:19:19.704308 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:19.704308 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:19:19.704308 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:19:19.704308 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:19:19.704308 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:19:19.704308 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:19:19.704308 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:19:19.704308 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:19:19.704308 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:19:19.704308 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99339e5a-af6a-4d00-a02b-cec028b663ae could not be found. Aug 19 21:19:19.704308 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:19.704308 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:19.704308 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:19.704308 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:19.704308 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:19.704308 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:19.704308 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:19:19.704308 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:19:19.704308 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:19:19.705877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:19:19.705877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 21:19:19.705877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 21:19:19.705877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 21:19:19.705877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 21:19:19.705877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:19:19.705877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:19:19.705877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:19:19.705877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:19:19.705877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99339e5a-af6a-4d00-a02b-cec028b663ae could not be found. Aug 19 21:19:19.705877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:19.705877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:19.705877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:19.705877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:19.705877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:19.705877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:19.705877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:19:19.705877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:19:19.705877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99339e5a-af6a-4d00-a02b-cec028b663ae could not be found. Aug 19 21:19:19.705877 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:19.707725 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-1956e4e8-d392-4407-89ab-ce2dac9f1a82 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Returning 404 to user: Instance 99339e5a-af6a-4d00-a02b-cec028b663ae could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:19:19.707725 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-1956e4e8-d392-4407-89ab-ce2dac9f1a82 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "DELETE /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 404 len: 111 microversion: 2.1 time: 0.038506 Aug 19 21:19:19.707725 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 431/936] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:19:19 2022] DELETE /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:19:19.711900 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-2480befd-5403-40e6-a2ce-2e4a13adddd6 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:19.712520 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-2480befd-5403-40e6-a2ce-2e4a13adddd6 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] [instance: 99339e5a-af6a-4d00-a02b-cec028b663ae] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:19.720546 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2480befd-5403-40e6-a2ce-2e4a13adddd6 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:19.721341 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2480befd-5403-40e6-a2ce-2e4a13adddd6 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:19.721814 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2480befd-5403-40e6-a2ce-2e4a13adddd6 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:19.722807 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2480befd-5403-40e6-a2ce-2e4a13adddd6 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:19.722976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2480befd-5403-40e6-a2ce-2e4a13adddd6 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:19.723590 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2480befd-5403-40e6-a2ce-2e4a13adddd6 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:19.738705 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-2480befd-5403-40e6-a2ce-2e4a13adddd6 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] HTTP exception thrown: Instance 99339e5a-af6a-4d00-a02b-cec028b663ae could not be found. Aug 19 21:19:19.740242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-2480befd-5403-40e6-a2ce-2e4a13adddd6 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Request method failure captured: Aug 19 21:19:19.740242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae HTTP/1.1 Aug 19 21:19:19.740242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:19:19.740242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:19:19.740242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:19:19.740242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:19:19.740242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:19:19.740242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:19:19.740242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:19:19.740242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:19:19.740242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__vTnxy0ZuRvCXYQHvdPUOIQ6IB7Tloqeiky5Yoiyt0Vgpb02m5mw3a2DEvQ0XyB7szWj5fdMvWapGqmCGDv7CfrB3Py-zgdnjUuiEJx19vEpXywPa2SVjntZLwoFOFk2XhitOUTwaBJ37dbyUmN2puMJZysaOLWl8Nrh88xp2dULAg Aug 19 21:19:19.740242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:19:19.740242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:19:19.740242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:19:19.740242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:19:19.740242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:19:19.740242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:19:19.740242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:19:19.740242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:19.740242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:19:19.740242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:19:19.741918 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/358e50f9b9df43b7aa0a4ba1353e4a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:19:19.741918 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:19.741918 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: 358e50f9b9df43b7aa0a4ba1353e4a25 Aug 19 21:19:19.741918 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632132370 Aug 19 21:19:19.741918 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:19:19.741918 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:19:19.741918 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:19:19.741918 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: 7f46019e78cc4e89bf877a4f5a7a8fe9 Aug 19 21:19:19.741918 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-AttachVolumeNegativeTest-1632132370-project Aug 19 21:19:19.741918 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: > Aug 19 21:19:19.741918 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Instance 99339e5a-af6a-4d00-a02b-cec028b663ae could not be found. Aug 19 21:19:19.741918 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'id': '99339e5a-af6a-4d00-a02b-cec028b663ae'} Aug 19 21:19:19.743024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:19:19.743024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:19.743024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:19:19.743024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:19:19.743024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:19:19.743024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:19:19.743024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:19:19.743024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:19:19.743024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:19:19.743024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:19:19.743024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99339e5a-af6a-4d00-a02b-cec028b663ae could not be found. Aug 19 21:19:19.743024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:19.743024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:19.743024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:19.743024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:19.743024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:19.743024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:19.743024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:19:19.743024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:19:19.743024 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:19:19.744397 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:19:19.744397 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:19:19.744397 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:19:19.744397 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:19:19.744397 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:19:19.744397 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:19:19.744397 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:19:19.744397 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99339e5a-af6a-4d00-a02b-cec028b663ae could not be found. Aug 19 21:19:19.744397 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:19.744397 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:19.744397 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:19.744397 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:19.744397 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:19.744397 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:19.744397 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:19:19.744397 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:19:19.744397 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99339e5a-af6a-4d00-a02b-cec028b663ae could not be found. Aug 19 21:19:19.744397 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:19.745507 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-2480befd-5403-40e6-a2ce-2e4a13adddd6 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] Returning 404 to user: Instance 99339e5a-af6a-4d00-a02b-cec028b663ae could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:19:19.745507 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-2480befd-5403-40e6-a2ce-2e4a13adddd6 tempest-AttachVolumeNegativeTest-1632132370 tempest-AttachVolumeNegativeTest-1632132370-project] 10.222.0.16 "GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae" status: 404 len: 111 microversion: 2.1 time: 0.033657 Aug 19 21:19:19.745507 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 506/937] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:19 2022] GET /compute/v2.1/servers/99339e5a-af6a-4d00-a02b-cec028b663ae => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:19:26.504512 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-e20cf286-3618-41fe-ba85-4ad7c216bec5 tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] Action: 'create', calling method: .version_select at 0x7f740bbb61f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-910436019", "metadata": {"Type": "work"}}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:19:26.517010 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-e20cf286-3618-41fe-ba85-4ad7c216bec5 tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] Request method failure captured: Aug 19 21:19:26.517010 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 19 21:19:26.517010 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:19:26.517010 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:19:26.517010 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:19:26.517010 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 121 Aug 19 21:19:26.517010 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:19:26.517010 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:19:26.517010 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:19:26.517010 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:19:26.517010 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__5e5LOERoSHhE_vyVEdqugVDglq1noKsK3XtLSBNbRKjAqyKBKopJkR7C_PhNzVoX5x-TopD1_yPmK7DqW-mcSOcQeHBiDAHN4IGkbBoheqfORtVDne1LYIJDpg4FgmwPakDvx-N-LnP6PsJWk8yrpf_4GZm8G8GiEkEXHP0XJZ1kg Aug 19 21:19:26.517010 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:19:26.517010 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:19:26.517010 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:19:26.517010 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:19:26.517010 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:19:26.517010 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:19:26.517010 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: c2e9ecda937c4259bf440a2fe303d5c5 Aug 19 21:19:26.517010 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-VolumesNegativeTest-1202628815 Aug 19 21:19:26.517010 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:19:26.517010 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:19:26.518921 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c2e9ecda937c4259bf440a2fe303d5c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c2e9ecda937c4259bf440a2fe303d5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c2e9ecda937c4259bf440a2fe303d5c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c2e9ecda937c4259bf440a2fe303d5c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:19:26.518921 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-VolumesNegativeTest-1202628815 Aug 19 21:19:26.518921 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: c2e9ecda937c4259bf440a2fe303d5c5 Aug 19 21:19:26.518921 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-VolumesNegativeTest-1202628815 Aug 19 21:19:26.518921 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-VolumesNegativeTest-1202628815-project Aug 19 21:19:26.518921 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:19:26.518921 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:19:26.518921 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: 362c9656f9b14fed96b930aa599cd480 Aug 19 21:19:26.518921 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-VolumesNegativeTest-1202628815-project Aug 19 21:19:26.518921 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Aug 19 21:19:26.518921 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-910436019", "metadata": {"Type": "work"}}} Aug 19 21:19:26.518921 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: Aug 19 21:19:26.518921 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 19 21:19:26.519909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-910436019', 'metadata': {'Type': 'work'}}}} Aug 19 21:19:26.519909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:19:26.519909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:26.519909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 19 21:19:26.519909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 19 21:19:26.519909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 19 21:19:26.519909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise error Aug 19 21:19:26.519909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 19 21:19:26.519909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.519909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 19 21:19:26.519909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 19 21:19:26.519909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.519909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 19 21:19:26.519909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi '#$%' Aug 19 21:19:26.519909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.519909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:26.519909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.519909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:26.519909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:26.519909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:26.519909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:19:26.519909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:19:26.521253 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 21:19:26.521253 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 21:19:26.521253 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:19:26.521253 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:19:26.521253 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 19 21:19:26.521253 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 19 21:19:26.521253 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 19 21:19:26.521253 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 19 21:19:26.521253 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 19 21:19:26.521253 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 19 21:19:26.521253 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 19 21:19:26.521253 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.521253 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:26.521253 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.521253 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:26.521253 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:26.521253 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:26.521253 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 19 21:19:26.521253 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 19 21:19:26.523385 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 19 21:19:26.523385 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.523385 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-e20cf286-3618-41fe-ba85-4ad7c216bec5 tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:19:26.523385 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-e20cf286-3618-41fe-ba85-4ad7c216bec5 tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.181371 Aug 19 21:19:26.524334 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 432/938] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Aug 19 21:19:26 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 187 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 19 21:19:26.529259 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-bd413392-3082-446c-bffa-7c2e841ba84b tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] Action: 'create', calling method: .version_select at 0x7f740ba96820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-992484613", "metadata": {"Type": "work"}}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:19:26.533876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-bd413392-3082-446c-bffa-7c2e841ba84b tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] Request method failure captured: Aug 19 21:19:26.533876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 19 21:19:26.533876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:19:26.533876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:19:26.533876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:19:26.533876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 119 Aug 19 21:19:26.533876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:19:26.533876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:19:26.533876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:19:26.533876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:19:26.533876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__5e5LOERoSHhE_vyVEdqugVDglq1noKsK3XtLSBNbRKjAqyKBKopJkR7C_PhNzVoX5x-TopD1_yPmK7DqW-mcSOcQeHBiDAHN4IGkbBoheqfORtVDne1LYIJDpg4FgmwPakDvx-N-LnP6PsJWk8yrpf_4GZm8G8GiEkEXHP0XJZ1kg Aug 19 21:19:26.533876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:19:26.533876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:19:26.533876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:19:26.533876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:19:26.533876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:19:26.533876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:19:26.533876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: c2e9ecda937c4259bf440a2fe303d5c5 Aug 19 21:19:26.533876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-VolumesNegativeTest-1202628815 Aug 19 21:19:26.533876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:19:26.533876 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:19:26.535273 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c2e9ecda937c4259bf440a2fe303d5c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c2e9ecda937c4259bf440a2fe303d5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c2e9ecda937c4259bf440a2fe303d5c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c2e9ecda937c4259bf440a2fe303d5c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:19:26.535273 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-VolumesNegativeTest-1202628815 Aug 19 21:19:26.535273 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: c2e9ecda937c4259bf440a2fe303d5c5 Aug 19 21:19:26.535273 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-VolumesNegativeTest-1202628815 Aug 19 21:19:26.535273 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-VolumesNegativeTest-1202628815-project Aug 19 21:19:26.535273 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:19:26.535273 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:19:26.535273 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: 362c9656f9b14fed96b930aa599cd480 Aug 19 21:19:26.535273 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-VolumesNegativeTest-1202628815-project Aug 19 21:19:26.535273 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Aug 19 21:19:26.535273 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-992484613", "metadata": {"Type": "work"}}} Aug 19 21:19:26.535273 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: Aug 19 21:19:26.535273 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 19 21:19:26.536099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-992484613', 'metadata': {'Type': 'work'}}}} Aug 19 21:19:26.536099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:19:26.536099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:26.536099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 19 21:19:26.536099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 19 21:19:26.536099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 19 21:19:26.536099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise error Aug 19 21:19:26.536099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 19 21:19:26.536099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.536099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 19 21:19:26.536099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 19 21:19:26.536099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.536099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 19 21:19:26.536099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi '0' Aug 19 21:19:26.536099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.536099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:26.536099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.536099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:26.536099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:26.536099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:26.536099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:19:26.536099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:19:26.537685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 21:19:26.537685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 21:19:26.537685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:19:26.537685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:19:26.537685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 19 21:19:26.537685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 19 21:19:26.537685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 19 21:19:26.537685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 19 21:19:26.537685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 19 21:19:26.537685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 19 21:19:26.537685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 19 21:19:26.537685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.537685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:26.537685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.537685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:26.537685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:26.537685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:26.537685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 19 21:19:26.537685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 19 21:19:26.538880 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 19 21:19:26.538880 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.540710 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-bd413392-3082-446c-bffa-7c2e841ba84b tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:19:26.541649 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-bd413392-3082-446c-bffa-7c2e841ba84b tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016915 Aug 19 21:19:26.542257 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 507/939] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Aug 19 21:19:26 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 19 21:19:26.553259 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-060bfc6a-c03b-45e9-985d-bb6541f68a72 tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] Action: 'create', calling method: .version_select at 0x7f740bb69dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-587501940", "metadata": {"Type": "work"}}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:19:26.560872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-060bfc6a-c03b-45e9-985d-bb6541f68a72 tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] Request method failure captured: Aug 19 21:19:26.560872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 19 21:19:26.560872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:19:26.560872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:19:26.560872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:19:26.560872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 118 Aug 19 21:19:26.560872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:19:26.560872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:19:26.560872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:19:26.560872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:19:26.560872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__5e5LOERoSHhE_vyVEdqugVDglq1noKsK3XtLSBNbRKjAqyKBKopJkR7C_PhNzVoX5x-TopD1_yPmK7DqW-mcSOcQeHBiDAHN4IGkbBoheqfORtVDne1LYIJDpg4FgmwPakDvx-N-LnP6PsJWk8yrpf_4GZm8G8GiEkEXHP0XJZ1kg Aug 19 21:19:26.560872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:19:26.560872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:19:26.560872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:19:26.560872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:19:26.560872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:19:26.560872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:19:26.560872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: c2e9ecda937c4259bf440a2fe303d5c5 Aug 19 21:19:26.560872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-VolumesNegativeTest-1202628815 Aug 19 21:19:26.560872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:19:26.560872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:19:26.562378 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c2e9ecda937c4259bf440a2fe303d5c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c2e9ecda937c4259bf440a2fe303d5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c2e9ecda937c4259bf440a2fe303d5c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c2e9ecda937c4259bf440a2fe303d5c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:19:26.562378 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-VolumesNegativeTest-1202628815 Aug 19 21:19:26.562378 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: c2e9ecda937c4259bf440a2fe303d5c5 Aug 19 21:19:26.562378 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-VolumesNegativeTest-1202628815 Aug 19 21:19:26.562378 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-VolumesNegativeTest-1202628815-project Aug 19 21:19:26.562378 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:19:26.562378 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:19:26.562378 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: 362c9656f9b14fed96b930aa599cd480 Aug 19 21:19:26.562378 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-VolumesNegativeTest-1202628815-project Aug 19 21:19:26.562378 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Aug 19 21:19:26.562378 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-587501940", "metadata": {"Type": "work"}}} Aug 19 21:19:26.562378 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: Aug 19 21:19:26.562378 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 19 21:19:26.567368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-587501940', 'metadata': {'Type': 'work'}}}} Aug 19 21:19:26.567368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:19:26.567368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:26.567368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 19 21:19:26.567368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 19 21:19:26.567368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 19 21:19:26.567368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise error Aug 19 21:19:26.567368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 19 21:19:26.567368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.567368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 19 21:19:26.567368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 19 21:19:26.567368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.567368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 19 21:19:26.567368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi '' Aug 19 21:19:26.567368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.567368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:26.567368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.567368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:26.567368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:26.567368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:26.567368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:19:26.567368 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:19:26.569079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 21:19:26.569079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 21:19:26.569079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:19:26.569079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:19:26.569079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 19 21:19:26.569079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 19 21:19:26.569079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 19 21:19:26.569079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 19 21:19:26.569079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 19 21:19:26.569079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 19 21:19:26.569079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 19 21:19:26.569079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.569079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:26.569079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.569079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:26.569079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:26.569079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:26.569079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 19 21:19:26.569079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 19 21:19:26.570521 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 19 21:19:26.570521 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.570521 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-060bfc6a-c03b-45e9-985d-bb6541f68a72 tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:19:26.570521 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-060bfc6a-c03b-45e9-985d-bb6541f68a72 tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013283 Aug 19 21:19:26.570521 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 433/940] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Aug 19 21:19:26 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 19 21:19:26.578467 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-afec8f80-6095-42da-853e-05413aba5613 tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] Calling method '.version_select at 0x7f740bc213a0>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:26.611409 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-afec8f80-6095-42da-853e-05413aba5613 tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] HTTP exception thrown: Volume tempest-invalid-212066926 could not be found. Aug 19 21:19:26.613501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-afec8f80-6095-42da-853e-05413aba5613 tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] Request method failure captured: Aug 19 21:19:26.613501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-212066926 HTTP/1.1 Aug 19 21:19:26.613501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:19:26.613501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:19:26.613501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:19:26.613501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:19:26.613501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:19:26.613501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:19:26.613501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:19:26.613501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:19:26.613501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__5e5LOERoSHhE_vyVEdqugVDglq1noKsK3XtLSBNbRKjAqyKBKopJkR7C_PhNzVoX5x-TopD1_yPmK7DqW-mcSOcQeHBiDAHN4IGkbBoheqfORtVDne1LYIJDpg4FgmwPakDvx-N-LnP6PsJWk8yrpf_4GZm8G8GiEkEXHP0XJZ1kg Aug 19 21:19:26.613501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:19:26.613501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:19:26.613501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:19:26.613501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:19:26.613501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:19:26.613501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:19:26.613501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: c2e9ecda937c4259bf440a2fe303d5c5 Aug 19 21:19:26.613501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-VolumesNegativeTest-1202628815 Aug 19 21:19:26.613501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:19:26.613501 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:19:26.615163 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c2e9ecda937c4259bf440a2fe303d5c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c2e9ecda937c4259bf440a2fe303d5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c2e9ecda937c4259bf440a2fe303d5c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c2e9ecda937c4259bf440a2fe303d5c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:19:26.615163 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-VolumesNegativeTest-1202628815 Aug 19 21:19:26.615163 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: c2e9ecda937c4259bf440a2fe303d5c5 Aug 19 21:19:26.615163 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-VolumesNegativeTest-1202628815 Aug 19 21:19:26.615163 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-VolumesNegativeTest-1202628815-project Aug 19 21:19:26.615163 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:19:26.615163 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:19:26.615163 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: 362c9656f9b14fed96b930aa599cd480 Aug 19 21:19:26.615163 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-VolumesNegativeTest-1202628815-project Aug 19 21:19:26.615163 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: Aug 19 21:19:26.615163 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Volume tempest-invalid-212066926 could not be found. Aug 19 21:19:26.615163 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'id': 'tempest-invalid-212066926'} Aug 19 21:19:26.615163 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:19:26.616201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:26.616201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 21:19:26.616201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 21:19:26.616201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 19 21:19:26.616201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 19 21:19:26.616201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 19 21:19:26.616201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 19 21:19:26.616201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 19 21:19:26.616201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 19 21:19:26.616201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 19 21:19:26.616201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 19 21:19:26.616201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 21:19:26.616201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 21:19:26.616201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 21:19:26.616201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 21:19:26.616201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-212066926 could not be found. (HTTP 404) (Request-ID: req-91d0cc35-e619-4c1f-b04b-c22fdb70a6e8) Aug 19 21:19:26.616201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.616201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:26.616201 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.617709 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:26.617709 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 19 21:19:26.617709 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 19 21:19:26.617709 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 19 21:19:26.617709 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 19 21:19:26.617709 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 19 21:19:26.617709 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 19 21:19:26.617709 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 19 21:19:26.617709 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 19 21:19:26.617709 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 21:19:26.617709 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 21:19:26.617709 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 19 21:19:26.617709 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 19 21:19:26.617709 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 19 21:19:26.617709 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 19 21:19:26.617709 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 19 21:19:26.617709 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 19 21:19:26.617709 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 19 21:19:26.617709 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 19 21:19:26.619394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 21:19:26.619394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 21:19:26.619394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 21:19:26.619394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 21:19:26.619394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-212066926 could not be found. Aug 19 21:19:26.619394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.619394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:26.619394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.619394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:26.619394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:26.619394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:26.619394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:19:26.619394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:19:26.619394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 21:19:26.619394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 21:19:26.619394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:19:26.619394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:19:26.619394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 19 21:19:26.619394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:19:26.619394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-212066926 could not be found. Aug 19 21:19:26.621150 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.621150 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:26.621150 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.621150 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:26.621150 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:26.621150 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:26.621150 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:19:26.621150 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:19:26.621150 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-212066926 could not be found. Aug 19 21:19:26.621150 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.621150 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-afec8f80-6095-42da-853e-05413aba5613 tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] Returning 404 to user: Volume tempest-invalid-212066926 could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:19:26.622598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-afec8f80-6095-42da-853e-05413aba5613 tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-212066926" status: 404 len: 98 microversion: 2.1 time: 0.047133 Aug 19 21:19:26.622598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 508/941] 10.222.0.16 () {58 vars in 1215 bytes} [Fri Aug 19 21:19:26 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-212066926 => generated 98 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 19 21:19:26.632962 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-399bf665-1490-4147-9342-89a48ed3bb40 tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004026 Aug 19 21:19:26.634802 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 434/942] 10.222.0.16 () {58 vars in 1140 bytes} [Fri Aug 19 21:19:26 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 19 21:19:26.644411 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-779369d0-96a2-4d97-b699-8b43602a8a3a tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004299 Aug 19 21:19:26.645164 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 509/943] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Aug 19 21:19:26 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 19 21:19:26.655313 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-44a9b318-6348-404d-98af-1eff012d8230 tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] Calling method '.version_select at 0x7f740bc35940>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:26.685515 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-44a9b318-6348-404d-98af-1eff012d8230 tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] HTTP exception thrown: Volume b612dff8-9646-4bd9-bdba-e1474fbea187 could not be found. Aug 19 21:19:26.687507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-44a9b318-6348-404d-98af-1eff012d8230 tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] Request method failure captured: Aug 19 21:19:26.687507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: DELETE /compute/v2.1/os-volumes/b612dff8-9646-4bd9-bdba-e1474fbea187 HTTP/1.1 Aug 19 21:19:26.687507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:19:26.687507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:19:26.687507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:19:26.687507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:19:26.687507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:19:26.687507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:19:26.687507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:19:26.687507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:19:26.687507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__5e5LOERoSHhE_vyVEdqugVDglq1noKsK3XtLSBNbRKjAqyKBKopJkR7C_PhNzVoX5x-TopD1_yPmK7DqW-mcSOcQeHBiDAHN4IGkbBoheqfORtVDne1LYIJDpg4FgmwPakDvx-N-LnP6PsJWk8yrpf_4GZm8G8GiEkEXHP0XJZ1kg Aug 19 21:19:26.687507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:19:26.687507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:19:26.687507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:19:26.687507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:19:26.687507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:19:26.687507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:19:26.687507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: c2e9ecda937c4259bf440a2fe303d5c5 Aug 19 21:19:26.687507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-VolumesNegativeTest-1202628815 Aug 19 21:19:26.687507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:19:26.687507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:19:26.689153 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c2e9ecda937c4259bf440a2fe303d5c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c2e9ecda937c4259bf440a2fe303d5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c2e9ecda937c4259bf440a2fe303d5c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c2e9ecda937c4259bf440a2fe303d5c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:19:26.689153 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-VolumesNegativeTest-1202628815 Aug 19 21:19:26.689153 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: c2e9ecda937c4259bf440a2fe303d5c5 Aug 19 21:19:26.689153 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-VolumesNegativeTest-1202628815 Aug 19 21:19:26.689153 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-VolumesNegativeTest-1202628815-project Aug 19 21:19:26.689153 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:19:26.689153 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:19:26.689153 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: 362c9656f9b14fed96b930aa599cd480 Aug 19 21:19:26.689153 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-VolumesNegativeTest-1202628815-project Aug 19 21:19:26.689153 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: Aug 19 21:19:26.689153 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Volume b612dff8-9646-4bd9-bdba-e1474fbea187 could not be found. Aug 19 21:19:26.689153 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': 'b612dff8-9646-4bd9-bdba-e1474fbea187'} Aug 19 21:19:26.689153 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:19:26.690388 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:26.690388 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 21:19:26.690388 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 21:19:26.690388 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 19 21:19:26.690388 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 19 21:19:26.690388 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 19 21:19:26.690388 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 19 21:19:26.690388 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 19 21:19:26.690388 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 19 21:19:26.690388 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 19 21:19:26.690388 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 19 21:19:26.690388 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 21:19:26.690388 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 21:19:26.690388 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 21:19:26.690388 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 21:19:26.690388 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b612dff8-9646-4bd9-bdba-e1474fbea187 could not be found. (HTTP 404) (Request-ID: req-169c5a1a-7cb0-4f58-b19f-2442b6e74897) Aug 19 21:19:26.690388 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.690388 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:26.690388 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.692121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:26.692121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 19 21:19:26.692121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 19 21:19:26.692121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 19 21:19:26.692121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 19 21:19:26.692121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 19 21:19:26.692121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 19 21:19:26.692121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 19 21:19:26.692121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 19 21:19:26.692121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 21:19:26.692121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 21:19:26.692121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 19 21:19:26.692121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 19 21:19:26.692121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 19 21:19:26.692121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 19 21:19:26.692121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 19 21:19:26.692121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 19 21:19:26.692121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 19 21:19:26.692121 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 19 21:19:26.693430 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 21:19:26.693430 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 21:19:26.693430 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 21:19:26.693430 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 21:19:26.693430 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b612dff8-9646-4bd9-bdba-e1474fbea187 could not be found. Aug 19 21:19:26.693430 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.693430 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:26.693430 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.693430 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:26.693430 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:26.693430 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:26.693430 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:19:26.693430 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:19:26.693430 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 21:19:26.693430 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 21:19:26.693430 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:19:26.693430 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:19:26.693430 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 19 21:19:26.693430 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:19:26.694879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b612dff8-9646-4bd9-bdba-e1474fbea187 could not be found. Aug 19 21:19:26.694879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.694879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:26.694879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.694879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:26.694879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:26.694879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:26.694879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:19:26.694879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:19:26.694879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b612dff8-9646-4bd9-bdba-e1474fbea187 could not be found. Aug 19 21:19:26.694879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.694879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-44a9b318-6348-404d-98af-1eff012d8230 tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] Returning 404 to user: Volume b612dff8-9646-4bd9-bdba-e1474fbea187 could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:19:26.694879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-44a9b318-6348-404d-98af-1eff012d8230 tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/b612dff8-9646-4bd9-bdba-e1474fbea187" status: 404 len: 109 microversion: 2.1 time: 0.038741 Aug 19 21:19:26.694879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 435/944] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Aug 19 21:19:26 2022] DELETE /compute/v2.1/os-volumes/b612dff8-9646-4bd9-bdba-e1474fbea187 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:19:26.704240 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-51326a68-ed7e-4edf-ab20-a31942c87f77 tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] Calling method '.version_select at 0x7f740ba96d30>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:26.734457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-51326a68-ed7e-4edf-ab20-a31942c87f77 tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] HTTP exception thrown: Volume bc4e5089-ee5c-498c-bc41-dbfb2fa9a075 could not be found. Aug 19 21:19:26.736487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-51326a68-ed7e-4edf-ab20-a31942c87f77 tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] Request method failure captured: Aug 19 21:19:26.736487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: GET /compute/v2.1/os-volumes/bc4e5089-ee5c-498c-bc41-dbfb2fa9a075 HTTP/1.1 Aug 19 21:19:26.736487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:19:26.736487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:19:26.736487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:19:26.736487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:19:26.736487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:19:26.736487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:19:26.736487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:19:26.736487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:19:26.736487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__5e5LOERoSHhE_vyVEdqugVDglq1noKsK3XtLSBNbRKjAqyKBKopJkR7C_PhNzVoX5x-TopD1_yPmK7DqW-mcSOcQeHBiDAHN4IGkbBoheqfORtVDne1LYIJDpg4FgmwPakDvx-N-LnP6PsJWk8yrpf_4GZm8G8GiEkEXHP0XJZ1kg Aug 19 21:19:26.736487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:19:26.736487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:19:26.736487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:19:26.736487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:19:26.736487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:19:26.736487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:19:26.736487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: c2e9ecda937c4259bf440a2fe303d5c5 Aug 19 21:19:26.736487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-VolumesNegativeTest-1202628815 Aug 19 21:19:26.736487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:19:26.736487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:19:26.738157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c2e9ecda937c4259bf440a2fe303d5c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c2e9ecda937c4259bf440a2fe303d5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c2e9ecda937c4259bf440a2fe303d5c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c2e9ecda937c4259bf440a2fe303d5c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:19:26.738157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-VolumesNegativeTest-1202628815 Aug 19 21:19:26.738157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: c2e9ecda937c4259bf440a2fe303d5c5 Aug 19 21:19:26.738157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-VolumesNegativeTest-1202628815 Aug 19 21:19:26.738157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-VolumesNegativeTest-1202628815-project Aug 19 21:19:26.738157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:19:26.738157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:19:26.738157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: 362c9656f9b14fed96b930aa599cd480 Aug 19 21:19:26.738157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-VolumesNegativeTest-1202628815-project Aug 19 21:19:26.738157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: Aug 19 21:19:26.738157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Volume bc4e5089-ee5c-498c-bc41-dbfb2fa9a075 could not be found. Aug 19 21:19:26.738157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'id': 'bc4e5089-ee5c-498c-bc41-dbfb2fa9a075'} Aug 19 21:19:26.738157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:19:26.739217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:26.739217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 21:19:26.739217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 21:19:26.739217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 19 21:19:26.739217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 19 21:19:26.739217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 19 21:19:26.739217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 19 21:19:26.739217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 21:19:26.739217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 21:19:26.739217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 21:19:26.739217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 21:19:26.739217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 21:19:26.739217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 21:19:26.739217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 21:19:26.739217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 21:19:26.739217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bc4e5089-ee5c-498c-bc41-dbfb2fa9a075 could not be found. (HTTP 404) (Request-ID: req-b9358a6d-0aca-4519-873a-e64da585c461) Aug 19 21:19:26.739217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.739217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:26.739217 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.740620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:26.740620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 19 21:19:26.740620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 19 21:19:26.740620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 19 21:19:26.740620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 19 21:19:26.740620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 19 21:19:26.740620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 19 21:19:26.740620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 19 21:19:26.740620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 19 21:19:26.740620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 21:19:26.740620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 21:19:26.740620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 19 21:19:26.740620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 19 21:19:26.740620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 19 21:19:26.740620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 19 21:19:26.740620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 21:19:26.740620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 21:19:26.740620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 21:19:26.740620 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 21:19:26.742265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 21:19:26.742265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 21:19:26.742265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 21:19:26.742265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 21:19:26.742265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bc4e5089-ee5c-498c-bc41-dbfb2fa9a075 could not be found. Aug 19 21:19:26.742265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.742265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:26.742265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.742265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:26.742265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:26.742265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:26.742265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:19:26.742265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:19:26.742265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 21:19:26.742265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 21:19:26.742265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:19:26.742265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:19:26.742265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 19 21:19:26.742265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:19:26.743646 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bc4e5089-ee5c-498c-bc41-dbfb2fa9a075 could not be found. Aug 19 21:19:26.743646 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.743646 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:26.743646 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.743646 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:26.743646 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:26.743646 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:26.743646 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:19:26.743646 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:19:26.743646 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bc4e5089-ee5c-498c-bc41-dbfb2fa9a075 could not be found. Aug 19 21:19:26.743646 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:26.743646 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-51326a68-ed7e-4edf-ab20-a31942c87f77 tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] Returning 404 to user: Volume bc4e5089-ee5c-498c-bc41-dbfb2fa9a075 could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:19:26.743646 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-51326a68-ed7e-4edf-ab20-a31942c87f77 tempest-VolumesNegativeTest-1202628815 tempest-VolumesNegativeTest-1202628815-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/bc4e5089-ee5c-498c-bc41-dbfb2fa9a075" status: 404 len: 109 microversion: 2.1 time: 0.042639 Aug 19 21:19:26.743646 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 510/945] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Aug 19 21:19:26 2022] GET /compute/v2.1/os-volumes/bc4e5089-ee5c-498c-bc41-dbfb2fa9a075 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:19:29.306468 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-ed98fd1d-508d-4407-8fa6-d13e8ea0c762 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:19:29.308622 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-ed98fd1d-508d-4407-8fa6-d13e8ea0c762 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:29.338917 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ed98fd1d-508d-4407-8fa6-d13e8ea0c762 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:29.346817 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ed98fd1d-508d-4407-8fa6-d13e8ea0c762 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:29.347844 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ed98fd1d-508d-4407-8fa6-d13e8ea0c762 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:29.349187 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ed98fd1d-508d-4407-8fa6-d13e8ea0c762 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:29.350583 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ed98fd1d-508d-4407-8fa6-d13e8ea0c762 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:29.354097 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ed98fd1d-508d-4407-8fa6-d13e8ea0c762 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:29.427737 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.objects.instance [None req-ed98fd1d-508d-4407-8fa6-d13e8ea0c762 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lazy-loading 'flavor' on Instance uuid 84087b72-4e56-413e-b975-c23f9f79d0d0 {{(pid=120876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:19:29.564078 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-ed98fd1d-508d-4407-8fa6-d13e8ea0c762 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "POST /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0/action" status: 202 len: 0 microversion: 2.1 time: 0.268562 Aug 19 21:19:29.575098 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-48582a2a-8661-4a5d-b17f-b78fb3e8023c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:29.577347 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-48582a2a-8661-4a5d-b17f-b78fb3e8023c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:29.580992 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 436/946] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Aug 19 21:19:29 2022] POST /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:19:29.592064 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-48582a2a-8661-4a5d-b17f-b78fb3e8023c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:29.592658 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-48582a2a-8661-4a5d-b17f-b78fb3e8023c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:29.593021 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-48582a2a-8661-4a5d-b17f-b78fb3e8023c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:29.593811 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-48582a2a-8661-4a5d-b17f-b78fb3e8023c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:29.594283 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-48582a2a-8661-4a5d-b17f-b78fb3e8023c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:29.594669 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-48582a2a-8661-4a5d-b17f-b78fb3e8023c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:29.843001 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-48582a2a-8661-4a5d-b17f-b78fb3e8023c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:29.851417 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-48582a2a-8661-4a5d-b17f-b78fb3e8023c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1566 microversion: 2.1 time: 0.281324 Aug 19 21:19:29.861967 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 511/947] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:29 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1566 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:30.877464 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-3b9d4c1f-fa11-440a-98c5-e2e8d28b85c3 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:30.878228 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-3b9d4c1f-fa11-440a-98c5-e2e8d28b85c3 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:30.885379 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3b9d4c1f-fa11-440a-98c5-e2e8d28b85c3 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:30.886243 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3b9d4c1f-fa11-440a-98c5-e2e8d28b85c3 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:30.893017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3b9d4c1f-fa11-440a-98c5-e2e8d28b85c3 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:30.895338 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3b9d4c1f-fa11-440a-98c5-e2e8d28b85c3 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:30.896066 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3b9d4c1f-fa11-440a-98c5-e2e8d28b85c3 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:30.896699 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3b9d4c1f-fa11-440a-98c5-e2e8d28b85c3 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:31.181043 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-3b9d4c1f-fa11-440a-98c5-e2e8d28b85c3 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:31.202896 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-3b9d4c1f-fa11-440a-98c5-e2e8d28b85c3 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1566 microversion: 2.1 time: 0.331099 Aug 19 21:19:31.205104 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 437/948] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:30 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1566 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:19:32.228222 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-36799574-bf8c-4ff8-99d1-5173cd28fdcb tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:32.229507 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-36799574-bf8c-4ff8-99d1-5173cd28fdcb tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:32.237858 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-36799574-bf8c-4ff8-99d1-5173cd28fdcb tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:32.238606 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-36799574-bf8c-4ff8-99d1-5173cd28fdcb tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:32.239316 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-36799574-bf8c-4ff8-99d1-5173cd28fdcb tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:32.249813 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e6eb3ae8-de9b-49f0-adb3-97e8d5635271 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Action: 'create', calling method: .version_select at 0x7f740bcd95e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1136394165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+7K4qsnoRSajUj5WkWzyK+mJobX9Ou3zXV4P7pLs+rC6uFSg579di96NaTzWybewXkQt2u6LN3soXx9oMUmhe77j8KgO+vyhUakXakgJMntQgZENZsK7K6TNaOceYGHQ=="}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:19:32.257358 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-36799574-bf8c-4ff8-99d1-5173cd28fdcb tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:32.257871 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-36799574-bf8c-4ff8-99d1-5173cd28fdcb tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:32.258312 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-36799574-bf8c-4ff8-99d1-5173cd28fdcb tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:32.280460 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-e6eb3ae8-de9b-49f0-adb3-97e8d5635271 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Getting quotas for project b5c70daaa3b340a286f8f4ebe26b807d. Resources: {'key_pairs'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:19:32.289417 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-e6eb3ae8-de9b-49f0-adb3-97e8d5635271 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Getting quotas for user d2749b3c8da94ce1b4af6c708a2f9db6 and project b5c70daaa3b340a286f8f4ebe26b807d. Resources: {'key_pairs'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:19:32.330186 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e6eb3ae8-de9b-49f0-adb3-97e8d5635271 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.513839 Aug 19 21:19:32.331257 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 512/949] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Aug 19 21:19:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:19:32.490422 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-36799574-bf8c-4ff8-99d1-5173cd28fdcb tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:32.507904 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-36799574-bf8c-4ff8-99d1-5173cd28fdcb tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1566 microversion: 2.1 time: 0.284359 Aug 19 21:19:32.521808 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 438/950] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:32 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1566 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:19:33.533404 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-7e9b32ed-1ca3-4b93-a2ef-b10231bb0827 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:33.534858 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-7e9b32ed-1ca3-4b93-a2ef-b10231bb0827 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:33.547523 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:19:33.550804 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7e9b32ed-1ca3-4b93-a2ef-b10231bb0827 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:33.552059 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7e9b32ed-1ca3-4b93-a2ef-b10231bb0827 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:33.552982 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7e9b32ed-1ca3-4b93-a2ef-b10231bb0827 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:33.554151 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7e9b32ed-1ca3-4b93-a2ef-b10231bb0827 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:33.555249 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7e9b32ed-1ca3-4b93-a2ef-b10231bb0827 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:33.555920 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7e9b32ed-1ca3-4b93-a2ef-b10231bb0827 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:33.564904 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=1 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:19:33.765835 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-7e9b32ed-1ca3-4b93-a2ef-b10231bb0827 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:33.778502 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-7e9b32ed-1ca3-4b93-a2ef-b10231bb0827 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1566 microversion: 2.1 time: 0.251174 Aug 19 21:19:33.782602 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 513/951] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:33 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1566 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:34.814490 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-b1d859dc-e071-4ee6-92de-cfffd326d473 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:34.815111 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-b1d859dc-e071-4ee6-92de-cfffd326d473 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:34.817504 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:19:34.834200 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b1d859dc-e071-4ee6-92de-cfffd326d473 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:34.834200 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b1d859dc-e071-4ee6-92de-cfffd326d473 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:34.834200 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b1d859dc-e071-4ee6-92de-cfffd326d473 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:34.834200 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b1d859dc-e071-4ee6-92de-cfffd326d473 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:34.834516 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b1d859dc-e071-4ee6-92de-cfffd326d473 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:34.834516 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b1d859dc-e071-4ee6-92de-cfffd326d473 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:34.834516 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:19:34.847579 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8b77e6c8-df99-47bf-9ab3-cd1a758a20b2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:34.849848 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8b77e6c8-df99-47bf-9ab3-cd1a758a20b2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:34.856773 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8b77e6c8-df99-47bf-9ab3-cd1a758a20b2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:34.857380 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8b77e6c8-df99-47bf-9ab3-cd1a758a20b2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:34.858050 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8b77e6c8-df99-47bf-9ab3-cd1a758a20b2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:34.858935 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8b77e6c8-df99-47bf-9ab3-cd1a758a20b2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:34.859613 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8b77e6c8-df99-47bf-9ab3-cd1a758a20b2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:34.860241 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8b77e6c8-df99-47bf-9ab3-cd1a758a20b2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:34.894407 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8b77e6c8-df99-47bf-9ab3-cd1a758a20b2 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050748 Aug 19 21:19:34.895850 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 514/952] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Aug 19 21:19:34 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:19:34.986569 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e1f9be06-e98c-467c-a328-fde43a5458ee tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:34.987244 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-e1f9be06-e98c-467c-a328-fde43a5458ee tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:34.993363 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e1f9be06-e98c-467c-a328-fde43a5458ee tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:34.994247 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e1f9be06-e98c-467c-a328-fde43a5458ee tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:34.994866 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e1f9be06-e98c-467c-a328-fde43a5458ee tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:34.995724 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e1f9be06-e98c-467c-a328-fde43a5458ee tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:34.996489 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e1f9be06-e98c-467c-a328-fde43a5458ee tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:34.997071 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e1f9be06-e98c-467c-a328-fde43a5458ee tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:35.024064 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-e1f9be06-e98c-467c-a328-fde43a5458ee tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Going to try to terminate instance {{(pid=120877) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 21:19:35.065707 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b1d859dc-e071-4ee6-92de-cfffd326d473 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:35.083463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-b1d859dc-e071-4ee6-92de-cfffd326d473 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1566 microversion: 2.1 time: 0.272735 Aug 19 21:19:35.084572 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 439/953] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:34 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1566 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:35.148117 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e1f9be06-e98c-467c-a328-fde43a5458ee tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 204 len: 0 microversion: 2.20 time: 0.165141 Aug 19 21:19:35.148814 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 515/954] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Aug 19 21:19:34 2022] DELETE /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 19 21:19:35.158035 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-7b42a82c-8adc-43b5-894a-ea480b729fb9 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:35.158646 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-7b42a82c-8adc-43b5-894a-ea480b729fb9 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:35.165267 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7b42a82c-8adc-43b5-894a-ea480b729fb9 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:35.166029 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7b42a82c-8adc-43b5-894a-ea480b729fb9 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:35.167094 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7b42a82c-8adc-43b5-894a-ea480b729fb9 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:35.168168 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7b42a82c-8adc-43b5-894a-ea480b729fb9 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:35.168858 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7b42a82c-8adc-43b5-894a-ea480b729fb9 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:35.169452 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7b42a82c-8adc-43b5-894a-ea480b729fb9 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:35.339022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-7b42a82c-8adc-43b5-894a-ea480b729fb9 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:35.347410 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-7b42a82c-8adc-43b5-894a-ea480b729fb9 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:35.348909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-7b42a82c-8adc-43b5-894a-ea480b729fb9 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:35.350113 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-7b42a82c-8adc-43b5-894a-ea480b729fb9 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1721 microversion: 2.20 time: 0.196090 Aug 19 21:19:35.350870 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 440/955] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:19:35 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:19:36.104417 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8707aa4e-d4f1-4d6d-a13b-d9c9cc61fd37 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:36.105140 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8707aa4e-d4f1-4d6d-a13b-d9c9cc61fd37 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:36.113120 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8707aa4e-d4f1-4d6d-a13b-d9c9cc61fd37 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:36.113939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8707aa4e-d4f1-4d6d-a13b-d9c9cc61fd37 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:36.114612 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8707aa4e-d4f1-4d6d-a13b-d9c9cc61fd37 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:36.117295 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8707aa4e-d4f1-4d6d-a13b-d9c9cc61fd37 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:36.118043 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8707aa4e-d4f1-4d6d-a13b-d9c9cc61fd37 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:36.118699 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8707aa4e-d4f1-4d6d-a13b-d9c9cc61fd37 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:36.350320 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8707aa4e-d4f1-4d6d-a13b-d9c9cc61fd37 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:36.365333 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8707aa4e-d4f1-4d6d-a13b-d9c9cc61fd37 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1566 microversion: 2.1 time: 0.265267 Aug 19 21:19:36.365966 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 516/956] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:36 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1566 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:36.375441 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-9ca4657d-cce3-4675-b9ad-867beb174cff tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:36.377013 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-9ca4657d-cce3-4675-b9ad-867beb174cff tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:36.392331 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9ca4657d-cce3-4675-b9ad-867beb174cff tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:36.393203 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9ca4657d-cce3-4675-b9ad-867beb174cff tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:36.395626 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9ca4657d-cce3-4675-b9ad-867beb174cff tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:36.396832 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9ca4657d-cce3-4675-b9ad-867beb174cff tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:36.397556 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9ca4657d-cce3-4675-b9ad-867beb174cff tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:36.398225 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9ca4657d-cce3-4675-b9ad-867beb174cff tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:36.657483 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9ca4657d-cce3-4675-b9ad-867beb174cff tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:36.667296 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9ca4657d-cce3-4675-b9ad-867beb174cff tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:36.670415 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9ca4657d-cce3-4675-b9ad-867beb174cff tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:36.671663 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-9ca4657d-cce3-4675-b9ad-867beb174cff tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1721 microversion: 2.20 time: 0.300263 Aug 19 21:19:36.677358 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 441/957] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:19:36 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1721 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:19:37.386526 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-77819dde-5e83-4056-b218-3f3e9ff51736 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:37.388107 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-77819dde-5e83-4056-b218-3f3e9ff51736 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:37.395305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-77819dde-5e83-4056-b218-3f3e9ff51736 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:37.396077 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-77819dde-5e83-4056-b218-3f3e9ff51736 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:37.396525 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-77819dde-5e83-4056-b218-3f3e9ff51736 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:37.397299 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-77819dde-5e83-4056-b218-3f3e9ff51736 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:37.397696 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-77819dde-5e83-4056-b218-3f3e9ff51736 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:37.398149 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-77819dde-5e83-4056-b218-3f3e9ff51736 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:37.615169 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-77819dde-5e83-4056-b218-3f3e9ff51736 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:37.626946 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-77819dde-5e83-4056-b218-3f3e9ff51736 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1566 microversion: 2.1 time: 0.244116 Aug 19 21:19:37.627719 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 517/958] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:37 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1566 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:37.708086 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-c045b187-0600-4479-b4ad-3327296cc6c6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:37.709806 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-c045b187-0600-4479-b4ad-3327296cc6c6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:37.722906 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c045b187-0600-4479-b4ad-3327296cc6c6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:37.723799 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c045b187-0600-4479-b4ad-3327296cc6c6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:37.724682 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c045b187-0600-4479-b4ad-3327296cc6c6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:37.725982 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c045b187-0600-4479-b4ad-3327296cc6c6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:37.726857 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c045b187-0600-4479-b4ad-3327296cc6c6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:37.727700 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c045b187-0600-4479-b4ad-3327296cc6c6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:37.811326 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-a5f15aac-a411-424a-832c-051ede706f14 req-68580c67-cb0a-4586-95cd-a31bb0cec259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5be0a3d-0419-4d69-83b2-22939e9c9bce", "name": "network-vif-deleted", "tag": "eb7288c4-808b-4ef2-91d6-8f6c15db4227"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:19:37.847710 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-a5f15aac-a411-424a-832c-051ede706f14 req-68580c67-cb0a-4586-95cd-a31bb0cec259 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:37.848594 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-a5f15aac-a411-424a-832c-051ede706f14 req-68580c67-cb0a-4586-95cd-a31bb0cec259 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:37.849310 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-a5f15aac-a411-424a-832c-051ede706f14 req-68580c67-cb0a-4586-95cd-a31bb0cec259 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:37.853883 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-c045b187-0600-4479-b4ad-3327296cc6c6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:37.867870 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-c045b187-0600-4479-b4ad-3327296cc6c6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:37.869497 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-c045b187-0600-4479-b4ad-3327296cc6c6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0809d96091c2476c83ec0c7c6c5a1509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3902dce55324b7ab42df9de97bc11b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:37.879451 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-a5f15aac-a411-424a-832c-051ede706f14 req-68580c67-cb0a-4586-95cd-a31bb0cec259 service nova] Creating event network-vif-deleted:eb7288c4-808b-4ef2-91d6-8f6c15db4227 for instance e5be0a3d-0419-4d69-83b2-22939e9c9bce on hv-cinder-85220 Aug 19 21:19:37.879955 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-c045b187-0600-4479-b4ad-3327296cc6c6 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 200 len: 1654 microversion: 2.20 time: 0.172450 Aug 19 21:19:37.890164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 442/959] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:19:37 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 1654 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 21:19:37.896739 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-a5f15aac-a411-424a-832c-051ede706f14 req-68580c67-cb0a-4586-95cd-a31bb0cec259 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090585 Aug 19 21:19:37.898736 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 518/960] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:19:38.655884 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-fca93ab1-03dd-4e2e-8a7d-fd5e5b2e6123 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:38.656408 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-fca93ab1-03dd-4e2e-8a7d-fd5e5b2e6123 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:38.662669 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fca93ab1-03dd-4e2e-8a7d-fd5e5b2e6123 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:38.663256 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fca93ab1-03dd-4e2e-8a7d-fd5e5b2e6123 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:38.663564 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fca93ab1-03dd-4e2e-8a7d-fd5e5b2e6123 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:38.664246 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fca93ab1-03dd-4e2e-8a7d-fd5e5b2e6123 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:38.664696 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fca93ab1-03dd-4e2e-8a7d-fd5e5b2e6123 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:38.665112 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fca93ab1-03dd-4e2e-8a7d-fd5e5b2e6123 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:38.811439 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-fca93ab1-03dd-4e2e-8a7d-fd5e5b2e6123 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:38.822343 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-fca93ab1-03dd-4e2e-8a7d-fd5e5b2e6123 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1566 microversion: 2.1 time: 0.170898 Aug 19 21:19:38.825316 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 443/961] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:38 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:38.906168 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-cb502534-de80-40d1-856b-cae29234d5ab tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:38.906783 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-cb502534-de80-40d1-856b-cae29234d5ab tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:38.913528 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cb502534-de80-40d1-856b-cae29234d5ab tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:38.914058 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cb502534-de80-40d1-856b-cae29234d5ab tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:38.914720 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cb502534-de80-40d1-856b-cae29234d5ab tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:38.916045 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cb502534-de80-40d1-856b-cae29234d5ab tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:38.916739 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cb502534-de80-40d1-856b-cae29234d5ab tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:38.917188 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cb502534-de80-40d1-856b-cae29234d5ab tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:38.943446 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-cb502534-de80-40d1-856b-cae29234d5ab tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] HTTP exception thrown: Instance e5be0a3d-0419-4d69-83b2-22939e9c9bce could not be found. Aug 19 21:19:38.946685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-cb502534-de80-40d1-856b-cae29234d5ab tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Request method failure captured: Aug 19 21:19:38.946685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce HTTP/1.1 Aug 19 21:19:38.946685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:19:38.946685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:19:38.946685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:19:38.946685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:19:38.946685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:19:38.946685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:19:38.946685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:19:38.946685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:19:38.946685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__vX_fd2XAzIVTVnzwahI5JEgSTO_ZQCd4mbb9Zg6m9XGpBqSdAXjvcFQkgBdJEQdhdc6Wn3XvPJ8COqP3gjKFf71Zr5Og6s5GWeMOn8LQQxkZ3vnUdBeNkhAKKtxlTTURC1_e0Ov1ivpWx03EqtnxIl4yPHSmieIQAxbvrtqBluopM Aug 19 21:19:38.946685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:19:38.946685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:19:38.946685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:19:38.946685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:19:38.946685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Openstack-Nova-Api-Version: 2.20 Aug 19 21:19:38.946685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:19:38.946685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:19:38.946685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: a3902dce55324b7ab42df9de97bc11b4 Aug 19 21:19:38.946685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1474752608 Aug 19 21:19:38.946685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:19:38.946685 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:19:38.948552 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a3902dce55324b7ab42df9de97bc11b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a3902dce55324b7ab42df9de97bc11b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a3902dce55324b7ab42df9de97bc11b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a3902dce55324b7ab42df9de97bc11b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:19:38.948552 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1474752608 Aug 19 21:19:38.948552 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: a3902dce55324b7ab42df9de97bc11b4 Aug 19 21:19:38.948552 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1474752608 Aug 19 21:19:38.948552 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-AttachVolumeShelveTestJSON-1474752608-project Aug 19 21:19:38.948552 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:19:38.948552 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:19:38.948552 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: 0809d96091c2476c83ec0c7c6c5a1509 Aug 19 21:19:38.948552 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1474752608-project Aug 19 21:19:38.948552 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: > Aug 19 21:19:38.948552 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Instance e5be0a3d-0419-4d69-83b2-22939e9c9bce could not be found. Aug 19 21:19:38.948552 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'id': 'e5be0a3d-0419-4d69-83b2-22939e9c9bce'} Aug 19 21:19:38.950210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:19:38.950210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:38.950210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:19:38.950210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:19:38.950210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:19:38.950210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:19:38.950210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:19:38.950210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:19:38.950210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:19:38.950210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:19:38.950210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5be0a3d-0419-4d69-83b2-22939e9c9bce could not be found. Aug 19 21:19:38.950210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:38.950210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:38.950210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:38.950210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:38.950210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:38.950210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:38.950210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:19:38.950210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:19:38.950210 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:19:38.951859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:19:38.951859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:19:38.951859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:19:38.951859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:19:38.951859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:19:38.951859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:19:38.951859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:19:38.951859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5be0a3d-0419-4d69-83b2-22939e9c9bce could not be found. Aug 19 21:19:38.951859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:38.951859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:38.951859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:38.951859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:38.951859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:38.951859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:38.951859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:19:38.951859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:19:38.951859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5be0a3d-0419-4d69-83b2-22939e9c9bce could not be found. Aug 19 21:19:38.951859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:38.953728 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-cb502534-de80-40d1-856b-cae29234d5ab tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Returning 404 to user: Instance e5be0a3d-0419-4d69-83b2-22939e9c9bce could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:19:38.953728 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-cb502534-de80-40d1-856b-cae29234d5ab tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 404 len: 111 microversion: 2.20 time: 0.047298 Aug 19 21:19:38.953728 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 519/962] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:19:38 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 19 21:19:38.958380 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-ead7fe16-7469-4b10-babc-252c3b87317b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '.version_select at 0x7f740bb69820>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:38.982751 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-ead7fe16-7469-4b10-babc-252c3b87317b tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1213874356" status: 204 len: 0 microversion: 2.20 time: 0.028212 Aug 19 21:19:38.983709 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 444/963] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Aug 19 21:19:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1213874356 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 19 21:19:39.846793 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-aeab9bea-0971-446c-b4c2-69e618dd9cca tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:39.847750 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-aeab9bea-0971-446c-b4c2-69e618dd9cca tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:39.853566 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-aeab9bea-0971-446c-b4c2-69e618dd9cca tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:39.854094 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-aeab9bea-0971-446c-b4c2-69e618dd9cca tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:39.854527 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-aeab9bea-0971-446c-b4c2-69e618dd9cca tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:39.855318 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-aeab9bea-0971-446c-b4c2-69e618dd9cca tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:39.856340 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-aeab9bea-0971-446c-b4c2-69e618dd9cca tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:39.856769 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-aeab9bea-0971-446c-b4c2-69e618dd9cca tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:40.292595 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-aeab9bea-0971-446c-b4c2-69e618dd9cca tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:40.301382 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-aeab9bea-0971-446c-b4c2-69e618dd9cca tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1566 microversion: 2.1 time: 0.459805 Aug 19 21:19:40.302341 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 520/964] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:39 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1566 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:40.826492 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-26165fa0-8d65-4c3b-9969-be8b44010945 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:40.827091 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-26165fa0-8d65-4c3b-9969-be8b44010945 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:40.833690 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-26165fa0-8d65-4c3b-9969-be8b44010945 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:40.834220 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-26165fa0-8d65-4c3b-9969-be8b44010945 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:40.834658 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-26165fa0-8d65-4c3b-9969-be8b44010945 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:40.835362 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-26165fa0-8d65-4c3b-9969-be8b44010945 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:40.835834 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-26165fa0-8d65-4c3b-9969-be8b44010945 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:40.836261 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-26165fa0-8d65-4c3b-9969-be8b44010945 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:40.852686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-26165fa0-8d65-4c3b-9969-be8b44010945 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] HTTP exception thrown: Instance e5be0a3d-0419-4d69-83b2-22939e9c9bce could not be found. Aug 19 21:19:40.854461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-26165fa0-8d65-4c3b-9969-be8b44010945 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Request method failure captured: Aug 19 21:19:40.854461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: DELETE /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce HTTP/1.1 Aug 19 21:19:40.854461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:19:40.854461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:19:40.854461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:19:40.854461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:19:40.854461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:19:40.854461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:19:40.854461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:19:40.854461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:19:40.854461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__vX_fd2XAzIVTVnzwahI5JEgSTO_ZQCd4mbb9Zg6m9XGpBqSdAXjvcFQkgBdJEQdhdc6Wn3XvPJ8COqP3gjKFf71Zr5Og6s5GWeMOn8LQQxkZ3vnUdBeNkhAKKtxlTTURC1_e0Ov1ivpWx03EqtnxIl4yPHSmieIQAxbvrtqBluopM Aug 19 21:19:40.854461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:19:40.854461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:19:40.854461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:19:40.854461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:19:40.854461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Openstack-Nova-Api-Version: 2.20 Aug 19 21:19:40.854461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:19:40.854461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:19:40.854461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: a3902dce55324b7ab42df9de97bc11b4 Aug 19 21:19:40.854461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1474752608 Aug 19 21:19:40.854461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:19:40.854461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:19:40.856349 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a3902dce55324b7ab42df9de97bc11b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a3902dce55324b7ab42df9de97bc11b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a3902dce55324b7ab42df9de97bc11b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a3902dce55324b7ab42df9de97bc11b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:19:40.856349 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1474752608 Aug 19 21:19:40.856349 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: a3902dce55324b7ab42df9de97bc11b4 Aug 19 21:19:40.856349 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1474752608 Aug 19 21:19:40.856349 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-AttachVolumeShelveTestJSON-1474752608-project Aug 19 21:19:40.856349 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:19:40.856349 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:19:40.856349 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: 0809d96091c2476c83ec0c7c6c5a1509 Aug 19 21:19:40.856349 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1474752608-project Aug 19 21:19:40.856349 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: > Aug 19 21:19:40.856349 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Instance e5be0a3d-0419-4d69-83b2-22939e9c9bce could not be found. Aug 19 21:19:40.856349 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': 'e5be0a3d-0419-4d69-83b2-22939e9c9bce'} Aug 19 21:19:40.857282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:19:40.857282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:40.857282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:19:40.857282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:19:40.857282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:19:40.857282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:19:40.857282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:19:40.857282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:19:40.857282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:19:40.857282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:19:40.857282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5be0a3d-0419-4d69-83b2-22939e9c9bce could not be found. Aug 19 21:19:40.857282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:40.857282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:40.857282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:40.857282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:40.857282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:40.857282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:40.857282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:19:40.857282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:19:40.857282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:19:40.858786 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:19:40.858786 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 21:19:40.858786 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 21:19:40.858786 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 21:19:40.858786 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 21:19:40.858786 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:19:40.858786 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:19:40.858786 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:19:40.858786 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:19:40.858786 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5be0a3d-0419-4d69-83b2-22939e9c9bce could not be found. Aug 19 21:19:40.858786 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:40.858786 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:40.858786 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:40.858786 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:40.858786 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:40.858786 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:40.858786 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:19:40.858786 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:19:40.858786 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5be0a3d-0419-4d69-83b2-22939e9c9bce could not be found. Aug 19 21:19:40.858786 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:40.860281 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-26165fa0-8d65-4c3b-9969-be8b44010945 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Returning 404 to user: Instance e5be0a3d-0419-4d69-83b2-22939e9c9bce could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:19:40.860281 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-26165fa0-8d65-4c3b-9969-be8b44010945 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 404 len: 111 microversion: 2.20 time: 0.034953 Aug 19 21:19:40.860281 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 445/965] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Aug 19 21:19:40 2022] DELETE /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 19 21:19:40.865971 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e699e4c4-2841-460a-8796-3b4291fb42d5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:40.866665 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-e699e4c4-2841-460a-8796-3b4291fb42d5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: e5be0a3d-0419-4d69-83b2-22939e9c9bce] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:40.876703 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e699e4c4-2841-460a-8796-3b4291fb42d5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:40.877196 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e699e4c4-2841-460a-8796-3b4291fb42d5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:40.877626 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e699e4c4-2841-460a-8796-3b4291fb42d5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:40.878364 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e699e4c4-2841-460a-8796-3b4291fb42d5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:40.878833 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e699e4c4-2841-460a-8796-3b4291fb42d5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:40.879236 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e699e4c4-2841-460a-8796-3b4291fb42d5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:40.895316 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-e699e4c4-2841-460a-8796-3b4291fb42d5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] HTTP exception thrown: Instance e5be0a3d-0419-4d69-83b2-22939e9c9bce could not be found. Aug 19 21:19:40.896888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e699e4c4-2841-460a-8796-3b4291fb42d5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Request method failure captured: Aug 19 21:19:40.896888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce HTTP/1.1 Aug 19 21:19:40.896888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:19:40.896888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:19:40.896888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:19:40.896888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:19:40.896888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:19:40.896888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:19:40.896888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:19:40.896888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:19:40.896888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__vX_fd2XAzIVTVnzwahI5JEgSTO_ZQCd4mbb9Zg6m9XGpBqSdAXjvcFQkgBdJEQdhdc6Wn3XvPJ8COqP3gjKFf71Zr5Og6s5GWeMOn8LQQxkZ3vnUdBeNkhAKKtxlTTURC1_e0Ov1ivpWx03EqtnxIl4yPHSmieIQAxbvrtqBluopM Aug 19 21:19:40.896888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:19:40.896888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:19:40.896888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:19:40.896888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:19:40.896888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Openstack-Nova-Api-Version: 2.20 Aug 19 21:19:40.896888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:19:40.896888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:19:40.896888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: a3902dce55324b7ab42df9de97bc11b4 Aug 19 21:19:40.896888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1474752608 Aug 19 21:19:40.896888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:19:40.896888 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:19:40.898689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a3902dce55324b7ab42df9de97bc11b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a3902dce55324b7ab42df9de97bc11b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a3902dce55324b7ab42df9de97bc11b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a3902dce55324b7ab42df9de97bc11b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:19:40.898689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1474752608 Aug 19 21:19:40.898689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: a3902dce55324b7ab42df9de97bc11b4 Aug 19 21:19:40.898689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1474752608 Aug 19 21:19:40.898689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-AttachVolumeShelveTestJSON-1474752608-project Aug 19 21:19:40.898689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:19:40.898689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:19:40.898689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: 0809d96091c2476c83ec0c7c6c5a1509 Aug 19 21:19:40.898689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1474752608-project Aug 19 21:19:40.898689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: > Aug 19 21:19:40.898689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Instance e5be0a3d-0419-4d69-83b2-22939e9c9bce could not be found. Aug 19 21:19:40.898689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'id': 'e5be0a3d-0419-4d69-83b2-22939e9c9bce'} Aug 19 21:19:40.899816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:19:40.899816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:40.899816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:19:40.899816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:19:40.899816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:19:40.899816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:19:40.899816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:19:40.899816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:19:40.899816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:19:40.899816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:19:40.899816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5be0a3d-0419-4d69-83b2-22939e9c9bce could not be found. Aug 19 21:19:40.899816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:40.899816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:40.899816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:40.899816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:40.899816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:40.899816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:40.899816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:19:40.899816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:19:40.899816 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:19:40.901356 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:19:40.901356 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:19:40.901356 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:19:40.901356 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:19:40.901356 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:19:40.901356 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:19:40.901356 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:19:40.901356 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5be0a3d-0419-4d69-83b2-22939e9c9bce could not be found. Aug 19 21:19:40.901356 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:40.901356 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:40.901356 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:40.901356 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:40.901356 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:40.901356 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:40.901356 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:19:40.901356 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:19:40.901356 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5be0a3d-0419-4d69-83b2-22939e9c9bce could not be found. Aug 19 21:19:40.901356 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:40.903783 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e699e4c4-2841-460a-8796-3b4291fb42d5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Returning 404 to user: Instance e5be0a3d-0419-4d69-83b2-22939e9c9bce could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:19:40.903783 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e699e4c4-2841-460a-8796-3b4291fb42d5 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce" status: 404 len: 111 microversion: 2.20 time: 0.037036 Aug 19 21:19:40.903783 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 521/966] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:19:40 2022] GET /compute/v2.1/servers/e5be0a3d-0419-4d69-83b2-22939e9c9bce => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 19 21:19:41.326154 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-70fab8d0-cab6-4adc-9278-e6738bd3c4af tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:41.326748 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-70fab8d0-cab6-4adc-9278-e6738bd3c4af tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:41.332761 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-70fab8d0-cab6-4adc-9278-e6738bd3c4af tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:41.333245 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-70fab8d0-cab6-4adc-9278-e6738bd3c4af tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:41.333671 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-70fab8d0-cab6-4adc-9278-e6738bd3c4af tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:41.334385 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-70fab8d0-cab6-4adc-9278-e6738bd3c4af tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:41.334835 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-70fab8d0-cab6-4adc-9278-e6738bd3c4af tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:41.335250 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-70fab8d0-cab6-4adc-9278-e6738bd3c4af tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:41.505116 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-70fab8d0-cab6-4adc-9278-e6738bd3c4af tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:41.514009 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-70fab8d0-cab6-4adc-9278-e6738bd3c4af tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1566 microversion: 2.1 time: 0.193585 Aug 19 21:19:41.514607 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 446/967] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:41 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1566 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:42.065937 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-38455a69-d55e-497f-ab18-a8ed5ad29181 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:42.066479 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-38455a69-d55e-497f-ab18-a8ed5ad29181 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:42.073756 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-38455a69-d55e-497f-ab18-a8ed5ad29181 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:42.075391 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-38455a69-d55e-497f-ab18-a8ed5ad29181 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:42.076000 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-38455a69-d55e-497f-ab18-a8ed5ad29181 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:42.076925 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-38455a69-d55e-497f-ab18-a8ed5ad29181 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:42.077434 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-38455a69-d55e-497f-ab18-a8ed5ad29181 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:42.078084 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-38455a69-d55e-497f-ab18-a8ed5ad29181 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:42.099276 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-38455a69-d55e-497f-ab18-a8ed5ad29181 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] HTTP exception thrown: Instance f95c060a-e4cc-436c-a185-9345fd2c44f2 could not be found. Aug 19 21:19:42.100922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-38455a69-d55e-497f-ab18-a8ed5ad29181 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Request method failure captured: Aug 19 21:19:42.100922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: DELETE /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 HTTP/1.1 Aug 19 21:19:42.100922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:19:42.100922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:19:42.100922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:19:42.100922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:19:42.100922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:19:42.100922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:19:42.100922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:19:42.100922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:19:42.100922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__vX_fd2XAzIVTVnzwahI5JEgSTO_ZQCd4mbb9Zg6m9XGpBqSdAXjvcFQkgBdJEQdhdc6Wn3XvPJ8COqP3gjKFf71Zr5Og6s5GWeMOn8LQQxkZ3vnUdBeNkhAKKtxlTTURC1_e0Ov1ivpWx03EqtnxIl4yPHSmieIQAxbvrtqBluopM Aug 19 21:19:42.100922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:19:42.100922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:19:42.100922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:19:42.100922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:19:42.100922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Openstack-Nova-Api-Version: 2.20 Aug 19 21:19:42.100922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:19:42.100922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:19:42.100922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: a3902dce55324b7ab42df9de97bc11b4 Aug 19 21:19:42.100922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1474752608 Aug 19 21:19:42.100922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:19:42.100922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:19:42.102520 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a3902dce55324b7ab42df9de97bc11b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a3902dce55324b7ab42df9de97bc11b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a3902dce55324b7ab42df9de97bc11b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a3902dce55324b7ab42df9de97bc11b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:19:42.102520 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1474752608 Aug 19 21:19:42.102520 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: a3902dce55324b7ab42df9de97bc11b4 Aug 19 21:19:42.102520 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1474752608 Aug 19 21:19:42.102520 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-AttachVolumeShelveTestJSON-1474752608-project Aug 19 21:19:42.102520 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:19:42.102520 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:19:42.102520 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: 0809d96091c2476c83ec0c7c6c5a1509 Aug 19 21:19:42.102520 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1474752608-project Aug 19 21:19:42.102520 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: > Aug 19 21:19:42.102520 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Instance f95c060a-e4cc-436c-a185-9345fd2c44f2 could not be found. Aug 19 21:19:42.102520 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'id': 'f95c060a-e4cc-436c-a185-9345fd2c44f2'} Aug 19 21:19:42.103443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:19:42.103443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:42.103443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:19:42.103443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:19:42.103443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:19:42.103443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:19:42.103443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:19:42.103443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:19:42.103443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:19:42.103443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:19:42.103443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f95c060a-e4cc-436c-a185-9345fd2c44f2 could not be found. Aug 19 21:19:42.103443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:42.103443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:42.103443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:42.103443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:42.103443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:42.103443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:42.103443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:19:42.103443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:19:42.103443 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:19:42.104930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:19:42.104930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 21:19:42.104930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 21:19:42.104930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 21:19:42.104930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 21:19:42.104930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:19:42.104930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:19:42.104930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:19:42.104930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:19:42.104930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f95c060a-e4cc-436c-a185-9345fd2c44f2 could not be found. Aug 19 21:19:42.104930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:42.104930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:42.104930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:42.104930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:42.104930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:42.104930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:42.104930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:19:42.104930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:19:42.104930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f95c060a-e4cc-436c-a185-9345fd2c44f2 could not be found. Aug 19 21:19:42.104930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:19:42.107566 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-38455a69-d55e-497f-ab18-a8ed5ad29181 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Returning 404 to user: Instance f95c060a-e4cc-436c-a185-9345fd2c44f2 could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:19:42.108716 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-38455a69-d55e-497f-ab18-a8ed5ad29181 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 404 len: 111 microversion: 2.20 time: 0.046615 Aug 19 21:19:42.109372 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 522/968] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Aug 19 21:19:42 2022] DELETE /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 19 21:19:42.117547 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d79b0df9-559b-4bcc-bfb0-63d9d696de52 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:42.118270 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-d79b0df9-559b-4bcc-bfb0-63d9d696de52 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] [instance: f95c060a-e4cc-436c-a185-9345fd2c44f2] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:42.127558 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d79b0df9-559b-4bcc-bfb0-63d9d696de52 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:42.128239 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d79b0df9-559b-4bcc-bfb0-63d9d696de52 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:42.128879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d79b0df9-559b-4bcc-bfb0-63d9d696de52 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:42.130103 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d79b0df9-559b-4bcc-bfb0-63d9d696de52 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:42.130231 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d79b0df9-559b-4bcc-bfb0-63d9d696de52 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:42.130627 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d79b0df9-559b-4bcc-bfb0-63d9d696de52 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:42.147433 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-d79b0df9-559b-4bcc-bfb0-63d9d696de52 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] HTTP exception thrown: Instance f95c060a-e4cc-436c-a185-9345fd2c44f2 could not be found. Aug 19 21:19:42.149022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d79b0df9-559b-4bcc-bfb0-63d9d696de52 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Request method failure captured: Aug 19 21:19:42.149022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 HTTP/1.1 Aug 19 21:19:42.149022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:19:42.149022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:19:42.149022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:19:42.149022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:19:42.149022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:19:42.149022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:19:42.149022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:19:42.149022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:19:42.149022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__vX_fd2XAzIVTVnzwahI5JEgSTO_ZQCd4mbb9Zg6m9XGpBqSdAXjvcFQkgBdJEQdhdc6Wn3XvPJ8COqP3gjKFf71Zr5Og6s5GWeMOn8LQQxkZ3vnUdBeNkhAKKtxlTTURC1_e0Ov1ivpWx03EqtnxIl4yPHSmieIQAxbvrtqBluopM Aug 19 21:19:42.149022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:19:42.149022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:19:42.149022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:19:42.149022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:19:42.149022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Openstack-Nova-Api-Version: 2.20 Aug 19 21:19:42.149022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:19:42.149022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:19:42.149022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: a3902dce55324b7ab42df9de97bc11b4 Aug 19 21:19:42.149022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1474752608 Aug 19 21:19:42.149022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:19:42.149022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:19:42.150706 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a3902dce55324b7ab42df9de97bc11b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a3902dce55324b7ab42df9de97bc11b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a3902dce55324b7ab42df9de97bc11b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a3902dce55324b7ab42df9de97bc11b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:19:42.150706 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1474752608 Aug 19 21:19:42.150706 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: a3902dce55324b7ab42df9de97bc11b4 Aug 19 21:19:42.150706 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1474752608 Aug 19 21:19:42.150706 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-AttachVolumeShelveTestJSON-1474752608-project Aug 19 21:19:42.150706 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:19:42.150706 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:19:42.150706 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: 0809d96091c2476c83ec0c7c6c5a1509 Aug 19 21:19:42.150706 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1474752608-project Aug 19 21:19:42.150706 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: > Aug 19 21:19:42.150706 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Instance f95c060a-e4cc-436c-a185-9345fd2c44f2 could not be found. Aug 19 21:19:42.150706 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': 'f95c060a-e4cc-436c-a185-9345fd2c44f2'} Aug 19 21:19:42.151542 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:19:42.151542 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:42.151542 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:19:42.151542 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:19:42.151542 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:19:42.151542 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:19:42.151542 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:19:42.151542 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:19:42.151542 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:19:42.151542 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:19:42.151542 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f95c060a-e4cc-436c-a185-9345fd2c44f2 could not be found. Aug 19 21:19:42.151542 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:42.151542 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:42.151542 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:42.151542 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:42.151542 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:42.151542 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:42.151542 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:19:42.151542 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:19:42.151542 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:19:42.153720 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:19:42.153720 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:19:42.153720 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:19:42.153720 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:19:42.153720 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:19:42.153720 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:19:42.153720 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:19:42.153720 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f95c060a-e4cc-436c-a185-9345fd2c44f2 could not be found. Aug 19 21:19:42.153720 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:42.153720 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:19:42.153720 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:42.153720 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:19:42.153720 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:19:42.153720 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:19:42.153720 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:19:42.153720 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:19:42.153720 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f95c060a-e4cc-436c-a185-9345fd2c44f2 could not be found. Aug 19 21:19:42.153720 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:19:42.156759 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d79b0df9-559b-4bcc-bfb0-63d9d696de52 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] Returning 404 to user: Instance f95c060a-e4cc-436c-a185-9345fd2c44f2 could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:19:42.156759 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-d79b0df9-559b-4bcc-bfb0-63d9d696de52 tempest-AttachVolumeShelveTestJSON-1474752608 tempest-AttachVolumeShelveTestJSON-1474752608-project] 10.222.0.16 "GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2" status: 404 len: 111 microversion: 2.20 time: 0.036880 Aug 19 21:19:42.156759 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 447/969] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Aug 19 21:19:42 2022] GET /compute/v2.1/servers/f95c060a-e4cc-436c-a185-9345fd2c44f2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 19 21:19:42.536481 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-4dc2737c-409e-410f-8111-ddd7717d0b42 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:42.537094 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-4dc2737c-409e-410f-8111-ddd7717d0b42 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:42.539408 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=4 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:19:42.547067 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4dc2737c-409e-410f-8111-ddd7717d0b42 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:42.547572 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4dc2737c-409e-410f-8111-ddd7717d0b42 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:42.548107 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4dc2737c-409e-410f-8111-ddd7717d0b42 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:42.549616 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4dc2737c-409e-410f-8111-ddd7717d0b42 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:42.550126 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4dc2737c-409e-410f-8111-ddd7717d0b42 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:42.551106 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4dc2737c-409e-410f-8111-ddd7717d0b42 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:42.792308 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-4dc2737c-409e-410f-8111-ddd7717d0b42 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:42.801039 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-4dc2737c-409e-410f-8111-ddd7717d0b42 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1566 microversion: 2.1 time: 0.268560 Aug 19 21:19:42.801622 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 523/970] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:42 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1566 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:43.823434 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-464ef737-da5a-4664-ae6d-c0b487d3c45a tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:43.824728 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-464ef737-da5a-4664-ae6d-c0b487d3c45a tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:43.831334 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-464ef737-da5a-4664-ae6d-c0b487d3c45a tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:43.831818 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-464ef737-da5a-4664-ae6d-c0b487d3c45a tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:43.832244 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-464ef737-da5a-4664-ae6d-c0b487d3c45a tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:43.832986 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-464ef737-da5a-4664-ae6d-c0b487d3c45a tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:43.833509 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-464ef737-da5a-4664-ae6d-c0b487d3c45a tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:43.834023 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-464ef737-da5a-4664-ae6d-c0b487d3c45a tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:44.075787 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-464ef737-da5a-4664-ae6d-c0b487d3c45a tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:44.083816 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-464ef737-da5a-4664-ae6d-c0b487d3c45a tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1507 microversion: 2.1 time: 0.264315 Aug 19 21:19:44.084538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 448/971] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:43 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1507 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:19:44.106205 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-2c3a6adf-325f-42b8-8f4a-233ba0723c39 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:19:44.106919 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-2c3a6adf-325f-42b8-8f4a-233ba0723c39 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:44.113600 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2c3a6adf-325f-42b8-8f4a-233ba0723c39 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:44.114493 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2c3a6adf-325f-42b8-8f4a-233ba0723c39 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:44.115094 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2c3a6adf-325f-42b8-8f4a-233ba0723c39 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:44.116061 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2c3a6adf-325f-42b8-8f4a-233ba0723c39 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:44.116475 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2c3a6adf-325f-42b8-8f4a-233ba0723c39 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:44.116893 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2c3a6adf-325f-42b8-8f4a-233ba0723c39 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:44.189013 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-2c3a6adf-325f-42b8-8f4a-233ba0723c39 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120877) unshelve /opt/stack/nova/nova/compute/api.py:4584}} Aug 19 21:19:44.267125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2c3a6adf-325f-42b8-8f4a-233ba0723c39 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [83c3979f-fb68-4761-9f49-529a75cc193e] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 19 21:19:45.198391 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-227c7239-485b-45c3-b9e8-a3055e6aa700 req-946bbe02-b980-4b46-bac6-4b9e437518e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84087b72-4e56-413e-b975-c23f9f79d0d0", "name": "network-vif-unplugged", "status": "completed", "tag": "702f349d-7673-4c52-a88b-8c4ef8a04aa4"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:19:45.209272 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-227c7239-485b-45c3-b9e8-a3055e6aa700 req-946bbe02-b980-4b46-bac6-4b9e437518e2 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:45.210409 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-227c7239-485b-45c3-b9e8-a3055e6aa700 req-946bbe02-b980-4b46-bac6-4b9e437518e2 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:45.211102 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-227c7239-485b-45c3-b9e8-a3055e6aa700 req-946bbe02-b980-4b46-bac6-4b9e437518e2 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:45.224941 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.compute.server_external_events [req-227c7239-485b-45c3-b9e8-a3055e6aa700 req-946bbe02-b980-4b46-bac6-4b9e437518e2 service nova] Unable to find a host for instance 84087b72-4e56-413e-b975-c23f9f79d0d0. Dropping event network-vif-unplugged {{(pid=120876) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 19 21:19:45.226139 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-227c7239-485b-45c3-b9e8-a3055e6aa700 req-946bbe02-b980-4b46-bac6-4b9e437518e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032262 Aug 19 21:19:45.227237 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 449/972] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 19 21:19:45.275911 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO oslo.messaging._drivers.impl_rabbit [None req-2c3a6adf-325f-42b8-8f4a-233ba0723c39 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [83c3979f-fb68-4761-9f49-529a75cc193e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34058. Aug 19 21:19:45.280755 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-2c3a6adf-325f-42b8-8f4a-233ba0723c39 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "POST /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0/action" status: 202 len: 0 microversion: 2.1 time: 1.179163 Aug 19 21:19:45.282190 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 524/973] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Aug 19 21:19:44 2022] POST /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0/action => generated 0 bytes in 1181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:19:45.294145 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-2d8c13ed-3500-48e4-bd96-8463c6914063 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:45.294437 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-2d8c13ed-3500-48e4-bd96-8463c6914063 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:45.302995 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2d8c13ed-3500-48e4-bd96-8463c6914063 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:45.303744 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2d8c13ed-3500-48e4-bd96-8463c6914063 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:45.304282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2d8c13ed-3500-48e4-bd96-8463c6914063 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:45.305661 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2d8c13ed-3500-48e4-bd96-8463c6914063 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:45.306425 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2d8c13ed-3500-48e4-bd96-8463c6914063 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:45.307014 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2d8c13ed-3500-48e4-bd96-8463c6914063 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:45.575597 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-2d8c13ed-3500-48e4-bd96-8463c6914063 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:45.584238 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-2d8c13ed-3500-48e4-bd96-8463c6914063 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1515 microversion: 2.1 time: 0.296527 Aug 19 21:19:45.597752 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 450/974] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:45 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1515 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:46.607754 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-1c24ce47-2ea0-4c3f-936c-3adcba216c2e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:46.608509 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-1c24ce47-2ea0-4c3f-936c-3adcba216c2e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:46.614864 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1c24ce47-2ea0-4c3f-936c-3adcba216c2e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:46.615421 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1c24ce47-2ea0-4c3f-936c-3adcba216c2e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:46.615934 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1c24ce47-2ea0-4c3f-936c-3adcba216c2e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:46.616701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1c24ce47-2ea0-4c3f-936c-3adcba216c2e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:46.617154 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1c24ce47-2ea0-4c3f-936c-3adcba216c2e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:46.617785 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1c24ce47-2ea0-4c3f-936c-3adcba216c2e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:46.794093 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-1c24ce47-2ea0-4c3f-936c-3adcba216c2e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:46.801986 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-1c24ce47-2ea0-4c3f-936c-3adcba216c2e tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1515 microversion: 2.1 time: 0.199388 Aug 19 21:19:46.802877 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 525/975] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:46 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1515 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:47.824427 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-92fa5b37-5511-41e1-82dd-e568747bddb7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:47.825250 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-92fa5b37-5511-41e1-82dd-e568747bddb7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:47.832041 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-92fa5b37-5511-41e1-82dd-e568747bddb7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:47.832529 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-92fa5b37-5511-41e1-82dd-e568747bddb7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:47.833878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-92fa5b37-5511-41e1-82dd-e568747bddb7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:47.833878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-92fa5b37-5511-41e1-82dd-e568747bddb7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:47.834151 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-92fa5b37-5511-41e1-82dd-e568747bddb7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:47.834575 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-92fa5b37-5511-41e1-82dd-e568747bddb7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:47.971955 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-92fa5b37-5511-41e1-82dd-e568747bddb7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:47.979721 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-92fa5b37-5511-41e1-82dd-e568747bddb7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1515 microversion: 2.1 time: 0.159821 Aug 19 21:19:47.980921 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 451/976] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:47 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:19:48.612242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-897b8e5e-2f92-40af-b3c7-dca13e2a0d92 tempest-VolumesTestJSON-2127594662 tempest-VolumesTestJSON-2127594662-project] Calling method '.version_select at 0x7f740bb028b0>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:48.660921 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-897b8e5e-2f92-40af-b3c7-dca13e2a0d92 tempest-VolumesTestJSON-2127594662 tempest-VolumesTestJSON-2127594662-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/57c10af6-43e0-45d9-85f0-655da615a3aa" status: 200 len: 351 microversion: 2.1 time: 0.052486 Aug 19 21:19:48.661487 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 526/977] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Aug 19 21:19:48 2022] GET /compute/v2.1/os-volumes/57c10af6-43e0-45d9-85f0-655da615a3aa => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:19:49.001060 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-51bb66c8-ff9c-4ea0-bbb7-e53911ff0d99 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:49.001922 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-51bb66c8-ff9c-4ea0-bbb7-e53911ff0d99 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:49.008694 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-51bb66c8-ff9c-4ea0-bbb7-e53911ff0d99 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:49.009181 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-51bb66c8-ff9c-4ea0-bbb7-e53911ff0d99 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:49.009614 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-51bb66c8-ff9c-4ea0-bbb7-e53911ff0d99 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:49.010336 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-51bb66c8-ff9c-4ea0-bbb7-e53911ff0d99 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:49.010793 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-51bb66c8-ff9c-4ea0-bbb7-e53911ff0d99 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:49.011213 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-51bb66c8-ff9c-4ea0-bbb7-e53911ff0d99 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:49.145391 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-51bb66c8-ff9c-4ea0-bbb7-e53911ff0d99 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:49.154066 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-51bb66c8-ff9c-4ea0-bbb7-e53911ff0d99 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1515 microversion: 2.1 time: 0.156704 Aug 19 21:19:49.154636 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 452/978] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:48 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:19:50.176617 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-913f3678-2879-433e-817a-cf9987138639 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:50.177404 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-913f3678-2879-433e-817a-cf9987138639 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:50.185152 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-913f3678-2879-433e-817a-cf9987138639 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:50.185645 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-913f3678-2879-433e-817a-cf9987138639 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:50.186115 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-913f3678-2879-433e-817a-cf9987138639 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:50.186812 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-913f3678-2879-433e-817a-cf9987138639 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:50.187265 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-913f3678-2879-433e-817a-cf9987138639 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:50.187689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-913f3678-2879-433e-817a-cf9987138639 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:50.328795 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-913f3678-2879-433e-817a-cf9987138639 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:50.336734 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-913f3678-2879-433e-817a-cf9987138639 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1515 microversion: 2.1 time: 0.165344 Aug 19 21:19:50.337299 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 527/979] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:50 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:51.063679 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-077d1518-aa47-489f-b37c-4ca94a657456 tempest-VolumesTestJSON-2127594662 tempest-VolumesTestJSON-2127594662-project] Calling method '.version_select at 0x7f740bbbe4c0>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:51.115496 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-077d1518-aa47-489f-b37c-4ca94a657456 tempest-VolumesTestJSON-2127594662 tempest-VolumesTestJSON-2127594662-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/b6384d96-2a2b-4503-b20d-806ae1115050" status: 200 len: 350 microversion: 2.1 time: 0.055718 Aug 19 21:19:51.116067 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 453/980] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Aug 19 21:19:51 2022] GET /compute/v2.1/os-volumes/b6384d96-2a2b-4503-b20d-806ae1115050 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:19:51.358513 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-77adb206-5ff0-43b7-ab7f-a77a93c8e743 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:51.359172 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-77adb206-5ff0-43b7-ab7f-a77a93c8e743 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:51.366731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-77adb206-5ff0-43b7-ab7f-a77a93c8e743 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:51.367731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-77adb206-5ff0-43b7-ab7f-a77a93c8e743 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:51.367731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-77adb206-5ff0-43b7-ab7f-a77a93c8e743 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:51.368343 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-77adb206-5ff0-43b7-ab7f-a77a93c8e743 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:51.368802 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-77adb206-5ff0-43b7-ab7f-a77a93c8e743 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:51.369226 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-77adb206-5ff0-43b7-ab7f-a77a93c8e743 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:51.538248 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-77adb206-5ff0-43b7-ab7f-a77a93c8e743 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:51.547022 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-77adb206-5ff0-43b7-ab7f-a77a93c8e743 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1573 microversion: 2.1 time: 0.193377 Aug 19 21:19:51.549844 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 528/981] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:51 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1573 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:52.462841 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-6d20fb53-4792-48b4-958a-98f0c66e3ce8 tempest-VolumesTestJSON-2127594662 tempest-VolumesTestJSON-2127594662-project] Calling method '.version_select at 0x7f740bc1d4c0>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:52.515618 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-6d20fb53-4792-48b4-958a-98f0c66e3ce8 tempest-VolumesTestJSON-2127594662 tempest-VolumesTestJSON-2127594662-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/31506ffe-b91e-4e51-abe4-3c078af4dca9" status: 200 len: 351 microversion: 2.1 time: 0.057318 Aug 19 21:19:52.516188 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 454/982] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Aug 19 21:19:52 2022] GET /compute/v2.1/os-volumes/31506ffe-b91e-4e51-abe4-3c078af4dca9 => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:19:52.530642 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-b7bd2a82-a74f-43b1-92b7-0d4f86560d86 tempest-VolumesTestJSON-2127594662 tempest-VolumesTestJSON-2127594662-project] Calling method '.version_select at 0x7f740bc2c040>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:52.570228 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-fee92fde-21e2-4a58-b378-a477af156dbe tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:52.570924 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-fee92fde-21e2-4a58-b378-a477af156dbe tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:52.578597 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fee92fde-21e2-4a58-b378-a477af156dbe tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:52.579093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fee92fde-21e2-4a58-b378-a477af156dbe tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:52.579748 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fee92fde-21e2-4a58-b378-a477af156dbe tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:52.580604 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fee92fde-21e2-4a58-b378-a477af156dbe tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:52.581062 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fee92fde-21e2-4a58-b378-a477af156dbe tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:52.581488 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fee92fde-21e2-4a58-b378-a477af156dbe tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:52.627762 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-b7bd2a82-a74f-43b1-92b7-0d4f86560d86 tempest-VolumesTestJSON-2127594662 tempest-VolumesTestJSON-2127594662-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.102207 Aug 19 21:19:52.628492 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 529/983] 10.222.0.16 () {58 vars in 1134 bytes} [Fri Aug 19 21:19:52 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:52.643328 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-dd1f30f5-5bc1-4a10-8188-88eed1600101 tempest-VolumesTestJSON-2127594662 tempest-VolumesTestJSON-2127594662-project] Calling method '.version_select at 0x7f740bc21e50>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:52.735641 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-dd1f30f5-5bc1-4a10-8188-88eed1600101 tempest-VolumesTestJSON-2127594662 tempest-VolumesTestJSON-2127594662-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.096296 Aug 19 21:19:52.736384 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 530/984] 10.222.0.16 () {58 vars in 1149 bytes} [Fri Aug 19 21:19:52 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:19:52.747039 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-fee92fde-21e2-4a58-b378-a477af156dbe tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:52.751066 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-2dfc7f05-a943-4cf5-b1f7-d30922a5048e tempest-VolumesTestJSON-2127594662 tempest-VolumesTestJSON-2127594662-project] Calling method '.version_select at 0x7f740bfce040>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:52.756942 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-fee92fde-21e2-4a58-b378-a477af156dbe tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1573 microversion: 2.1 time: 0.190780 Aug 19 21:19:52.757517 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 455/985] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:52 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1573 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:52.853974 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-2dfc7f05-a943-4cf5-b1f7-d30922a5048e tempest-VolumesTestJSON-2127594662 tempest-VolumesTestJSON-2127594662-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.108064 Aug 19 21:19:52.854537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 531/986] 10.222.0.16 () {58 vars in 1134 bytes} [Fri Aug 19 21:19:52 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:19:52.868634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d972b776-f975-4842-9120-6843a0c9b3c3 tempest-VolumesTestJSON-2127594662 tempest-VolumesTestJSON-2127594662-project] Calling method '.version_select at 0x7f740bbb6700>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:52.954242 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-d972b776-f975-4842-9120-6843a0c9b3c3 tempest-VolumesTestJSON-2127594662 tempest-VolumesTestJSON-2127594662-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.089354 Aug 19 21:19:52.954810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 456/987] 10.222.0.16 () {58 vars in 1167 bytes} [Fri Aug 19 21:19:52 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:19:52.969675 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-f2d650fe-0596-4918-a515-51d32d9ed407 tempest-VolumesTestJSON-2127594662 tempest-VolumesTestJSON-2127594662-project] Calling method '.version_select at 0x7f740bc98b80>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:53.054167 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-f2d650fe-0596-4918-a515-51d32d9ed407 tempest-VolumesTestJSON-2127594662 tempest-VolumesTestJSON-2127594662-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089352 Aug 19 21:19:53.054732 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 532/988] 10.222.0.16 () {58 vars in 1170 bytes} [Fri Aug 19 21:19:52 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:19:53.068055 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-cb79b04d-aa1f-4d9f-a1a9-5be6401b4ad7 tempest-VolumesTestJSON-2127594662 tempest-VolumesTestJSON-2127594662-project] Calling method '.version_select at 0x7f740bc1df70>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:53.154692 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-cb79b04d-aa1f-4d9f-a1a9-5be6401b4ad7 tempest-VolumesTestJSON-2127594662 tempest-VolumesTestJSON-2127594662-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.090348 Aug 19 21:19:53.155470 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 457/989] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Aug 19 21:19:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:53.169049 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-5bac8131-3548-4131-b9ae-041642083eed tempest-VolumesTestJSON-2127594662 tempest-VolumesTestJSON-2127594662-project] Calling method '.version_select at 0x7f740bc5de50>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:53.261355 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-5bac8131-3548-4131-b9ae-041642083eed tempest-VolumesTestJSON-2127594662 tempest-VolumesTestJSON-2127594662-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.096349 Aug 19 21:19:53.262543 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 533/990] 10.222.0.16 () {58 vars in 1188 bytes} [Fri Aug 19 21:19:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:19:53.279221 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-865dea86-1300-4be6-8c37-15425427dcab tempest-VolumesTestJSON-2127594662 tempest-VolumesTestJSON-2127594662-project] Calling method '.version_select at 0x7f740bb575e0>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:53.373038 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-865dea86-1300-4be6-8c37-15425427dcab tempest-VolumesTestJSON-2127594662 tempest-VolumesTestJSON-2127594662-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.099305 Aug 19 21:19:53.373949 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 458/991] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Aug 19 21:19:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:53.781301 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-34452a64-a4cc-4c8f-a9c7-c896d252f585 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:53.781959 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-34452a64-a4cc-4c8f-a9c7-c896d252f585 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:53.787972 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-34452a64-a4cc-4c8f-a9c7-c896d252f585 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:53.788459 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-34452a64-a4cc-4c8f-a9c7-c896d252f585 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:53.788913 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-34452a64-a4cc-4c8f-a9c7-c896d252f585 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:53.789592 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-34452a64-a4cc-4c8f-a9c7-c896d252f585 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:53.790077 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-34452a64-a4cc-4c8f-a9c7-c896d252f585 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:53.791087 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-34452a64-a4cc-4c8f-a9c7-c896d252f585 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:53.934873 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-34452a64-a4cc-4c8f-a9c7-c896d252f585 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:53.942642 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-34452a64-a4cc-4c8f-a9c7-c896d252f585 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1573 microversion: 2.1 time: 0.167295 Aug 19 21:19:53.943297 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 534/992] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:53 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1573 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:54.966146 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-644202f9-71b6-463a-884d-dc7586e46b5c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:54.966964 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-644202f9-71b6-463a-884d-dc7586e46b5c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:54.973166 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-644202f9-71b6-463a-884d-dc7586e46b5c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:54.973645 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-644202f9-71b6-463a-884d-dc7586e46b5c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:54.974150 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-644202f9-71b6-463a-884d-dc7586e46b5c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:54.974943 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-644202f9-71b6-463a-884d-dc7586e46b5c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:54.975404 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-644202f9-71b6-463a-884d-dc7586e46b5c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:54.975823 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-644202f9-71b6-463a-884d-dc7586e46b5c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:55.104926 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-644202f9-71b6-463a-884d-dc7586e46b5c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:55.113277 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-644202f9-71b6-463a-884d-dc7586e46b5c tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1573 microversion: 2.1 time: 0.153430 Aug 19 21:19:55.113854 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 459/993] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:54 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:56.134476 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-561cef05-c9f2-45fc-911a-986e3ba1b1ae tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:56.135124 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-561cef05-c9f2-45fc-911a-986e3ba1b1ae tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:56.142433 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-561cef05-c9f2-45fc-911a-986e3ba1b1ae tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:56.142914 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-561cef05-c9f2-45fc-911a-986e3ba1b1ae tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:56.143378 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-561cef05-c9f2-45fc-911a-986e3ba1b1ae tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:56.144068 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-561cef05-c9f2-45fc-911a-986e3ba1b1ae tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:56.144552 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-561cef05-c9f2-45fc-911a-986e3ba1b1ae tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:56.145002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-561cef05-c9f2-45fc-911a-986e3ba1b1ae tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:56.290369 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-561cef05-c9f2-45fc-911a-986e3ba1b1ae tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:56.292559 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:19:56.299964 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-561cef05-c9f2-45fc-911a-986e3ba1b1ae tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1573 microversion: 2.1 time: 0.169352 Aug 19 21:19:56.300531 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 535/994] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:56 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1573 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:56.605090 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-e7af01c0-30f6-4eea-88c1-8a4d9c8432d8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1458837149", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1136394165", "security_groups": [{"name": "tempest-secgroup-smoke-1474901084"}], "block_device_mapping_v2": [{"uuid": "a3d9f46d-5c06-426a-a2f4-94fda6095b52", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "467ee159-81ce-42fd-8258-d5228258cf1c"}]}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:19:56.718027 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.network.neutron [None req-e7af01c0-30f6-4eea-88c1-8a4d9c8432d8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] validate_networks() for [('467ee159-81ce-42fd-8258-d5228258cf1c', None, None, None, None, None)] {{(pid=120876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 21:19:57.115942 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-e7af01c0-30f6-4eea-88c1-8a4d9c8432d8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Flavor limits 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 21:19:57.116468 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-e7af01c0-30f6-4eea-88c1-8a4d9c8432d8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Image limits 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 21:19:57.117003 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-e7af01c0-30f6-4eea-88c1-8a4d9c8432d8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Flavor pref 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 21:19:57.117417 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-e7af01c0-30f6-4eea-88c1-8a4d9c8432d8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Image pref 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 21:19:57.118659 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-e7af01c0-30f6-4eea-88c1-8a4d9c8432d8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 21:19:57.130647 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e7af01c0-30f6-4eea-88c1-8a4d9c8432d8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:57.131408 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e7af01c0-30f6-4eea-88c1-8a4d9c8432d8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:57.132023 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e7af01c0-30f6-4eea-88c1-8a4d9c8432d8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:57.133468 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e7af01c0-30f6-4eea-88c1-8a4d9c8432d8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:57.133970 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e7af01c0-30f6-4eea-88c1-8a4d9c8432d8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:57.134431 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e7af01c0-30f6-4eea-88c1-8a4d9c8432d8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:57.153568 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-e7af01c0-30f6-4eea-88c1-8a4d9c8432d8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Getting quotas for project b5c70daaa3b340a286f8f4ebe26b807d. Resources: {'cores', 'ram', 'instances'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:19:57.157665 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-e7af01c0-30f6-4eea-88c1-8a4d9c8432d8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Getting quotas for user d2749b3c8da94ce1b4af6c708a2f9db6 and project b5c70daaa3b340a286f8f4ebe26b807d. Resources: {'cores', 'ram', 'instances'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:19:57.224715 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-e7af01c0-30f6-4eea-88c1-8a4d9c8432d8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Going to run 1 instances... {{(pid=120876) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 21:19:57.227470 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-e7af01c0-30f6-4eea-88c1-8a4d9c8432d8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a3d9f46d-5c06-426a-a2f4-94fda6095b52',volume_size=None,volume_type=None)] {{(pid=120876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 21:19:57.324719 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0cf50951-7865-4ab5-b1e6-ac5bd5dfb389 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:57.325939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0cf50951-7865-4ab5-b1e6-ac5bd5dfb389 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:57.336732 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0cf50951-7865-4ab5-b1e6-ac5bd5dfb389 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:57.338223 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0cf50951-7865-4ab5-b1e6-ac5bd5dfb389 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:57.338818 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0cf50951-7865-4ab5-b1e6-ac5bd5dfb389 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:57.339690 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0cf50951-7865-4ab5-b1e6-ac5bd5dfb389 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:57.340402 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0cf50951-7865-4ab5-b1e6-ac5bd5dfb389 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:57.341038 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0cf50951-7865-4ab5-b1e6-ac5bd5dfb389 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:57.404438 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-e7af01c0-30f6-4eea-88c1-8a4d9c8432d8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.803146 Aug 19 21:19:57.405426 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 460/995] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Aug 19 21:19:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 21:19:57.416370 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-5183ca3d-8d42-4d9d-8463-05521c239d88 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:57.416987 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-5183ca3d-8d42-4d9d-8463-05521c239d88 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:57.530092 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-5183ca3d-8d42-4d9d-8463-05521c239d88 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:57.537688 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-5183ca3d-8d42-4d9d-8463-05521c239d88 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 200 len: 1095 microversion: 2.1 time: 0.125295 Aug 19 21:19:57.550011 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 461/996] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:57 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 1095 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:19:57.597910 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0cf50951-7865-4ab5-b1e6-ac5bd5dfb389 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:57.608813 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0cf50951-7865-4ab5-b1e6-ac5bd5dfb389 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1573 microversion: 2.1 time: 0.289814 Aug 19 21:19:57.612484 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 536/997] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:57 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1573 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:58.570546 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-6fccc4b3-ce58-4595-8468-babcff67f152 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:58.571233 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-6fccc4b3-ce58-4595-8468-babcff67f152 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:58.579612 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6fccc4b3-ce58-4595-8468-babcff67f152 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:58.580416 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6fccc4b3-ce58-4595-8468-babcff67f152 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:58.581593 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6fccc4b3-ce58-4595-8468-babcff67f152 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:58.582688 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6fccc4b3-ce58-4595-8468-babcff67f152 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:58.583353 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6fccc4b3-ce58-4595-8468-babcff67f152 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:58.583990 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6fccc4b3-ce58-4595-8468-babcff67f152 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:58.636440 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-1f2383d1-36d7-469b-8622-e60cc2109076 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:58.637058 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-1f2383d1-36d7-469b-8622-e60cc2109076 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:58.670797 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1f2383d1-36d7-469b-8622-e60cc2109076 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:58.672823 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1f2383d1-36d7-469b-8622-e60cc2109076 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:58.673689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1f2383d1-36d7-469b-8622-e60cc2109076 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:58.674872 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1f2383d1-36d7-469b-8622-e60cc2109076 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:58.675605 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1f2383d1-36d7-469b-8622-e60cc2109076 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:58.676831 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1f2383d1-36d7-469b-8622-e60cc2109076 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:58.704874 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-6fccc4b3-ce58-4595-8468-babcff67f152 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:58.713194 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-6fccc4b3-ce58-4595-8468-babcff67f152 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 200 len: 1193 microversion: 2.1 time: 0.147002 Aug 19 21:19:58.726416 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 462/998] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:58 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 1193 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:58.859135 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-1f2383d1-36d7-469b-8622-e60cc2109076 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:19:58.872057 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-1f2383d1-36d7-469b-8622-e60cc2109076 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1573 microversion: 2.1 time: 0.239429 Aug 19 21:19:58.872921 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 537/999] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:58 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1573 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:19:59.738525 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-a0d1570d-52fa-4d2b-9294-7be371639eae tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:59.739342 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-a0d1570d-52fa-4d2b-9294-7be371639eae tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:59.745426 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a0d1570d-52fa-4d2b-9294-7be371639eae tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:59.746558 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a0d1570d-52fa-4d2b-9294-7be371639eae tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:59.747291 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a0d1570d-52fa-4d2b-9294-7be371639eae tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:59.748255 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a0d1570d-52fa-4d2b-9294-7be371639eae tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:59.748707 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a0d1570d-52fa-4d2b-9294-7be371639eae tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:59.749126 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-a0d1570d-52fa-4d2b-9294-7be371639eae tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:59.896521 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8f19602c-8207-4192-822b-ad8536e54737 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:19:59.897691 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8f19602c-8207-4192-822b-ad8536e54737 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:19:59.915341 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8f19602c-8207-4192-822b-ad8536e54737 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:59.916320 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8f19602c-8207-4192-822b-ad8536e54737 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:59.917140 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8f19602c-8207-4192-822b-ad8536e54737 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:19:59.919966 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8f19602c-8207-4192-822b-ad8536e54737 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:19:59.920980 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8f19602c-8207-4192-822b-ad8536e54737 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:19:59.925048 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8f19602c-8207-4192-822b-ad8536e54737 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:00.350980 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-a0d1570d-52fa-4d2b-9294-7be371639eae tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:00.368950 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-a0d1570d-52fa-4d2b-9294-7be371639eae tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 200 len: 1211 microversion: 2.1 time: 0.628500 Aug 19 21:20:00.370089 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 463/1000] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:59 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 1211 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:00.435729 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8f19602c-8207-4192-822b-ad8536e54737 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:00.444985 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8f19602c-8207-4192-822b-ad8536e54737 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1573 microversion: 2.1 time: 0.553721 Aug 19 21:20:00.458714 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 538/1001] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:19:59 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1573 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:20:01.299132 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-09ecb4fb-6a0f-4aca-bf5b-734d4b215cae req-5e263190-e785-47ce-9521-66d4b7a80724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67d0593a-5bf1-4f0d-94ac-89589766e987", "tag": "6d5e449a-8209-480b-a248-e22d0f1c6658"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:20:01.316661 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-09ecb4fb-6a0f-4aca-bf5b-734d4b215cae req-5e263190-e785-47ce-9521-66d4b7a80724 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:01.317395 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-09ecb4fb-6a0f-4aca-bf5b-734d4b215cae req-5e263190-e785-47ce-9521-66d4b7a80724 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:01.319112 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-09ecb4fb-6a0f-4aca-bf5b-734d4b215cae req-5e263190-e785-47ce-9521-66d4b7a80724 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:01.346840 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-09ecb4fb-6a0f-4aca-bf5b-734d4b215cae req-5e263190-e785-47ce-9521-66d4b7a80724 service nova] Creating event network-changed:6d5e449a-8209-480b-a248-e22d0f1c6658 for instance 67d0593a-5bf1-4f0d-94ac-89589766e987 on hv-cinder-85220 Aug 19 21:20:01.352458 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-09ecb4fb-6a0f-4aca-bf5b-734d4b215cae req-5e263190-e785-47ce-9521-66d4b7a80724 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059641 Aug 19 21:20:01.353228 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 464/1002] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:20:01.391613 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-fa681523-9382-4771-bc3f-52fc4dc62cc1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:01.392601 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-fa681523-9382-4771-bc3f-52fc4dc62cc1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:01.402113 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fa681523-9382-4771-bc3f-52fc4dc62cc1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:01.403571 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fa681523-9382-4771-bc3f-52fc4dc62cc1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:01.404022 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fa681523-9382-4771-bc3f-52fc4dc62cc1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:01.404844 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fa681523-9382-4771-bc3f-52fc4dc62cc1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:01.405360 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fa681523-9382-4771-bc3f-52fc4dc62cc1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:01.406910 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-fa681523-9382-4771-bc3f-52fc4dc62cc1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:01.472243 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-68bcb501-e347-47ff-ad55-ab80b573564b tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:01.473124 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-68bcb501-e347-47ff-ad55-ab80b573564b tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:01.485114 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-68bcb501-e347-47ff-ad55-ab80b573564b tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:01.485617 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-68bcb501-e347-47ff-ad55-ab80b573564b tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:01.486081 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-68bcb501-e347-47ff-ad55-ab80b573564b tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:01.486825 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-68bcb501-e347-47ff-ad55-ab80b573564b tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:01.487279 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-68bcb501-e347-47ff-ad55-ab80b573564b tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:01.487699 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-68bcb501-e347-47ff-ad55-ab80b573564b tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:01.629715 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-fa681523-9382-4771-bc3f-52fc4dc62cc1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:01.644478 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-fa681523-9382-4771-bc3f-52fc4dc62cc1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 200 len: 1267 microversion: 2.1 time: 0.256526 Aug 19 21:20:01.644801 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 539/1003] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:01 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 1267 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:20:01.692861 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-68bcb501-e347-47ff-ad55-ab80b573564b tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:01.703791 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-68bcb501-e347-47ff-ad55-ab80b573564b tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1573 microversion: 2.1 time: 0.240102 Aug 19 21:20:01.709599 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 465/1004] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:01 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1573 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:02.666226 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ceb19e2f-bec1-4529-a2b1-cdff72551d30 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:02.667122 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ceb19e2f-bec1-4529-a2b1-cdff72551d30 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:02.674178 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ceb19e2f-bec1-4529-a2b1-cdff72551d30 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:02.674666 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ceb19e2f-bec1-4529-a2b1-cdff72551d30 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:02.675105 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ceb19e2f-bec1-4529-a2b1-cdff72551d30 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:02.675960 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ceb19e2f-bec1-4529-a2b1-cdff72551d30 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:02.676413 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ceb19e2f-bec1-4529-a2b1-cdff72551d30 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:02.676951 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ceb19e2f-bec1-4529-a2b1-cdff72551d30 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:02.729257 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-5da4f9e3-311f-476d-ad6f-8d316477fade tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:02.731240 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-5da4f9e3-311f-476d-ad6f-8d316477fade tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:02.738295 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5da4f9e3-311f-476d-ad6f-8d316477fade tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:02.738909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5da4f9e3-311f-476d-ad6f-8d316477fade tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:02.739433 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5da4f9e3-311f-476d-ad6f-8d316477fade tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:02.740392 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5da4f9e3-311f-476d-ad6f-8d316477fade tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:02.740944 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5da4f9e3-311f-476d-ad6f-8d316477fade tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:02.741544 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-5da4f9e3-311f-476d-ad6f-8d316477fade tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:02.746587 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=100 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:20:02.885313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ceb19e2f-bec1-4529-a2b1-cdff72551d30 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:02.894900 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ceb19e2f-bec1-4529-a2b1-cdff72551d30 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 200 len: 1267 microversion: 2.1 time: 0.232097 Aug 19 21:20:02.910213 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 540/1005] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:02 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 1267 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:02.948229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-5da4f9e3-311f-476d-ad6f-8d316477fade tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:02.956669 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-5da4f9e3-311f-476d-ad6f-8d316477fade tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1573 microversion: 2.1 time: 0.232055 Aug 19 21:20:02.957850 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 466/1006] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:02 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1573 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:03.561437 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-77a806aa-53ca-4a5b-81c0-d2997e67790d req-06a4d799-79b1-4654-b736-14c0ae2d8f7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84087b72-4e56-413e-b975-c23f9f79d0d0", "name": "network-vif-plugged", "status": "completed", "tag": "702f349d-7673-4c52-a88b-8c4ef8a04aa4"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:20:03.572283 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-77a806aa-53ca-4a5b-81c0-d2997e67790d req-06a4d799-79b1-4654-b736-14c0ae2d8f7d service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:03.573046 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-77a806aa-53ca-4a5b-81c0-d2997e67790d req-06a4d799-79b1-4654-b736-14c0ae2d8f7d service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:03.573791 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-77a806aa-53ca-4a5b-81c0-d2997e67790d req-06a4d799-79b1-4654-b736-14c0ae2d8f7d service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:03.586934 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-77a806aa-53ca-4a5b-81c0-d2997e67790d req-06a4d799-79b1-4654-b736-14c0ae2d8f7d service nova] Creating event network-vif-plugged:702f349d-7673-4c52-a88b-8c4ef8a04aa4 for instance 84087b72-4e56-413e-b975-c23f9f79d0d0 on hv-cinder-85220 Aug 19 21:20:03.593659 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-77a806aa-53ca-4a5b-81c0-d2997e67790d req-06a4d799-79b1-4654-b736-14c0ae2d8f7d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239758 Aug 19 21:20:03.594734 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 541/1007] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:20:03.923067 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-3a02e105-0d39-4ac1-840e-51a23f00e4f6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:03.923067 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-3a02e105-0d39-4ac1-840e-51a23f00e4f6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:03.926454 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3a02e105-0d39-4ac1-840e-51a23f00e4f6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:03.926934 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3a02e105-0d39-4ac1-840e-51a23f00e4f6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:03.927367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3a02e105-0d39-4ac1-840e-51a23f00e4f6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:03.928068 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3a02e105-0d39-4ac1-840e-51a23f00e4f6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:03.928512 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3a02e105-0d39-4ac1-840e-51a23f00e4f6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:03.928924 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3a02e105-0d39-4ac1-840e-51a23f00e4f6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:03.980211 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-00fed41f-c942-49f0-83d3-2c2a4208dc43 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:03.981467 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-00fed41f-c942-49f0-83d3-2c2a4208dc43 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:03.984425 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:20:03.990278 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-00fed41f-c942-49f0-83d3-2c2a4208dc43 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:03.990897 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-00fed41f-c942-49f0-83d3-2c2a4208dc43 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:03.991452 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-00fed41f-c942-49f0-83d3-2c2a4208dc43 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:03.992301 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-00fed41f-c942-49f0-83d3-2c2a4208dc43 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:03.992883 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-00fed41f-c942-49f0-83d3-2c2a4208dc43 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:03.993541 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-00fed41f-c942-49f0-83d3-2c2a4208dc43 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:04.140024 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-3a02e105-0d39-4ac1-840e-51a23f00e4f6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:04.148113 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-3a02e105-0d39-4ac1-840e-51a23f00e4f6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 200 len: 1267 microversion: 2.1 time: 0.232471 Aug 19 21:20:04.148891 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 467/1008] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:03 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:04.187268 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-00fed41f-c942-49f0-83d3-2c2a4208dc43 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:04.196676 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-00fed41f-c942-49f0-83d3-2c2a4208dc43 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1573 microversion: 2.1 time: 0.220368 Aug 19 21:20:04.197497 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 542/1009] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:03 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1573 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:05.169567 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-6395bad9-70ac-47e4-975d-ae83fed2b6ff tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:05.170269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-6395bad9-70ac-47e4-975d-ae83fed2b6ff tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:05.172783 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:20:05.181692 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6395bad9-70ac-47e4-975d-ae83fed2b6ff tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:05.182271 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6395bad9-70ac-47e4-975d-ae83fed2b6ff tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:05.182708 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6395bad9-70ac-47e4-975d-ae83fed2b6ff tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:05.183399 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6395bad9-70ac-47e4-975d-ae83fed2b6ff tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:05.184375 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6395bad9-70ac-47e4-975d-ae83fed2b6ff tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:05.185090 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6395bad9-70ac-47e4-975d-ae83fed2b6ff tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:05.220049 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-f9eb6bf5-0e16-4657-9369-e084ca495440 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:05.221539 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-f9eb6bf5-0e16-4657-9369-e084ca495440 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:05.231912 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f9eb6bf5-0e16-4657-9369-e084ca495440 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:05.232614 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f9eb6bf5-0e16-4657-9369-e084ca495440 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:05.233208 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f9eb6bf5-0e16-4657-9369-e084ca495440 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:05.234148 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f9eb6bf5-0e16-4657-9369-e084ca495440 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:05.234594 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f9eb6bf5-0e16-4657-9369-e084ca495440 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:05.235014 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f9eb6bf5-0e16-4657-9369-e084ca495440 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:05.397757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-6395bad9-70ac-47e4-975d-ae83fed2b6ff tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:05.414145 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-6395bad9-70ac-47e4-975d-ae83fed2b6ff tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 200 len: 1267 microversion: 2.1 time: 0.248243 Aug 19 21:20:05.414856 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 468/1010] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:05 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 1267 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:05.445320 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-f9eb6bf5-0e16-4657-9369-e084ca495440 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:05.453929 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-f9eb6bf5-0e16-4657-9369-e084ca495440 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1573 microversion: 2.1 time: 0.238925 Aug 19 21:20:05.454756 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 543/1011] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:05 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1573 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:20:06.437065 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-eb3b38b4-087a-4063-86de-bfacd4307cba tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:06.437834 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-eb3b38b4-087a-4063-86de-bfacd4307cba tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:06.444831 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-eb3b38b4-087a-4063-86de-bfacd4307cba tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:06.445393 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-eb3b38b4-087a-4063-86de-bfacd4307cba tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:06.445923 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-eb3b38b4-087a-4063-86de-bfacd4307cba tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:06.446689 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-eb3b38b4-087a-4063-86de-bfacd4307cba tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:06.447222 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-eb3b38b4-087a-4063-86de-bfacd4307cba tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:06.447727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-eb3b38b4-087a-4063-86de-bfacd4307cba tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:06.477046 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-d4570e64-17ca-4a62-a49d-6c3e13bba494 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:06.477697 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-d4570e64-17ca-4a62-a49d-6c3e13bba494 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:06.485253 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d4570e64-17ca-4a62-a49d-6c3e13bba494 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:06.485749 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d4570e64-17ca-4a62-a49d-6c3e13bba494 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:06.486221 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d4570e64-17ca-4a62-a49d-6c3e13bba494 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:06.486963 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d4570e64-17ca-4a62-a49d-6c3e13bba494 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:06.487410 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d4570e64-17ca-4a62-a49d-6c3e13bba494 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:06.487837 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d4570e64-17ca-4a62-a49d-6c3e13bba494 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:06.682080 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-eb3b38b4-087a-4063-86de-bfacd4307cba tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:06.691318 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-eb3b38b4-087a-4063-86de-bfacd4307cba tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 200 len: 1267 microversion: 2.1 time: 0.258182 Aug 19 21:20:06.696238 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-d4570e64-17ca-4a62-a49d-6c3e13bba494 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:06.706209 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 469/1012] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:06 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 1267 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:06.709744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-d4570e64-17ca-4a62-a49d-6c3e13bba494 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1560 microversion: 2.1 time: 0.237753 Aug 19 21:20:06.710452 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 544/1013] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:06 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1560 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:20:07.713327 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-6feb4fff-9c31-498b-94f5-26117fc6522c tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:07.713965 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-6feb4fff-9c31-498b-94f5-26117fc6522c tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:07.715812 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=2 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:20:07.716937 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=8 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:20:07.723534 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6feb4fff-9c31-498b-94f5-26117fc6522c tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:07.724028 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6feb4fff-9c31-498b-94f5-26117fc6522c tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:07.726310 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6feb4fff-9c31-498b-94f5-26117fc6522c tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:07.726310 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6feb4fff-9c31-498b-94f5-26117fc6522c tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:07.726310 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6feb4fff-9c31-498b-94f5-26117fc6522c tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:07.726310 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-6feb4fff-9c31-498b-94f5-26117fc6522c tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:07.872302 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-6feb4fff-9c31-498b-94f5-26117fc6522c tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:07.880211 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-6feb4fff-9c31-498b-94f5-26117fc6522c tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 200 len: 1267 microversion: 2.1 time: 0.170781 Aug 19 21:20:07.880770 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 470/1014] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:07 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:08.902376 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-2a1a98d6-3bb0-4e03-98bb-72c7799b5cfe tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:08.902987 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-2a1a98d6-3bb0-4e03-98bb-72c7799b5cfe tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:08.909489 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2a1a98d6-3bb0-4e03-98bb-72c7799b5cfe tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:08.910005 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2a1a98d6-3bb0-4e03-98bb-72c7799b5cfe tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:08.910444 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2a1a98d6-3bb0-4e03-98bb-72c7799b5cfe tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:08.911132 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2a1a98d6-3bb0-4e03-98bb-72c7799b5cfe tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:08.911587 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2a1a98d6-3bb0-4e03-98bb-72c7799b5cfe tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:08.912012 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2a1a98d6-3bb0-4e03-98bb-72c7799b5cfe tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:09.057468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-2a1a98d6-3bb0-4e03-98bb-72c7799b5cfe tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:09.065970 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-2a1a98d6-3bb0-4e03-98bb-72c7799b5cfe tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 200 len: 1267 microversion: 2.1 time: 0.167426 Aug 19 21:20:09.066550 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 545/1015] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:08 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:10.087208 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-e5a1e068-427c-4cd4-be0b-cc96d1b564db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:10.087917 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-e5a1e068-427c-4cd4-be0b-cc96d1b564db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:10.095391 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e5a1e068-427c-4cd4-be0b-cc96d1b564db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:10.095870 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e5a1e068-427c-4cd4-be0b-cc96d1b564db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:10.096296 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e5a1e068-427c-4cd4-be0b-cc96d1b564db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:10.096983 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e5a1e068-427c-4cd4-be0b-cc96d1b564db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:10.097433 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e5a1e068-427c-4cd4-be0b-cc96d1b564db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:10.097885 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e5a1e068-427c-4cd4-be0b-cc96d1b564db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:10.231052 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-e5a1e068-427c-4cd4-be0b-cc96d1b564db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:10.237630 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-e5a1e068-427c-4cd4-be0b-cc96d1b564db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 200 len: 1267 microversion: 2.1 time: 0.154262 Aug 19 21:20:10.238218 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 471/1016] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:10 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:11.262708 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-dbfb34dc-9c74-462f-80f0-8b6d34938d77 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:11.263367 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-dbfb34dc-9c74-462f-80f0-8b6d34938d77 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:11.276874 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dbfb34dc-9c74-462f-80f0-8b6d34938d77 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:11.278303 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dbfb34dc-9c74-462f-80f0-8b6d34938d77 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:11.278429 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dbfb34dc-9c74-462f-80f0-8b6d34938d77 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:11.279090 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dbfb34dc-9c74-462f-80f0-8b6d34938d77 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:11.279539 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dbfb34dc-9c74-462f-80f0-8b6d34938d77 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:11.279957 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dbfb34dc-9c74-462f-80f0-8b6d34938d77 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:11.426969 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-dbfb34dc-9c74-462f-80f0-8b6d34938d77 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:11.435688 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-dbfb34dc-9c74-462f-80f0-8b6d34938d77 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 200 len: 1267 microversion: 2.1 time: 0.177319 Aug 19 21:20:11.436257 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 546/1017] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:11 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:12.456525 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-90cf1005-2876-4781-ae7c-2eae3f9cf3fe tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:12.457235 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-90cf1005-2876-4781-ae7c-2eae3f9cf3fe tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:12.463541 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-90cf1005-2876-4781-ae7c-2eae3f9cf3fe tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:12.464148 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-90cf1005-2876-4781-ae7c-2eae3f9cf3fe tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:12.464591 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-90cf1005-2876-4781-ae7c-2eae3f9cf3fe tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:12.465345 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-90cf1005-2876-4781-ae7c-2eae3f9cf3fe tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:12.465826 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-90cf1005-2876-4781-ae7c-2eae3f9cf3fe tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:12.466341 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-90cf1005-2876-4781-ae7c-2eae3f9cf3fe tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:12.599967 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-90cf1005-2876-4781-ae7c-2eae3f9cf3fe tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:12.609586 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-90cf1005-2876-4781-ae7c-2eae3f9cf3fe tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 200 len: 1267 microversion: 2.1 time: 0.156412 Aug 19 21:20:12.610117 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 472/1018] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:12 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:13.630757 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-80f5228a-eb6a-4aa7-b807-984d1bed9132 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:13.631356 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-80f5228a-eb6a-4aa7-b807-984d1bed9132 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:13.638701 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-80f5228a-eb6a-4aa7-b807-984d1bed9132 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:13.639116 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-80f5228a-eb6a-4aa7-b807-984d1bed9132 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:13.639545 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-80f5228a-eb6a-4aa7-b807-984d1bed9132 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:13.640226 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-80f5228a-eb6a-4aa7-b807-984d1bed9132 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:13.640672 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-80f5228a-eb6a-4aa7-b807-984d1bed9132 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:13.641088 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-80f5228a-eb6a-4aa7-b807-984d1bed9132 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:13.779181 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-80f5228a-eb6a-4aa7-b807-984d1bed9132 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:13.787070 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-80f5228a-eb6a-4aa7-b807-984d1bed9132 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 200 len: 1267 microversion: 2.1 time: 0.160330 Aug 19 21:20:13.787647 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 547/1019] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:13 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:14.807397 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-74c2f95e-e42f-4f63-b7ed-0fe13f35b557 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:14.808014 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-74c2f95e-e42f-4f63-b7ed-0fe13f35b557 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:14.814707 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-74c2f95e-e42f-4f63-b7ed-0fe13f35b557 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:14.815197 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-74c2f95e-e42f-4f63-b7ed-0fe13f35b557 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:14.815634 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-74c2f95e-e42f-4f63-b7ed-0fe13f35b557 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:14.816325 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-74c2f95e-e42f-4f63-b7ed-0fe13f35b557 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:14.816782 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-74c2f95e-e42f-4f63-b7ed-0fe13f35b557 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:14.817204 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-74c2f95e-e42f-4f63-b7ed-0fe13f35b557 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:14.947888 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-74c2f95e-e42f-4f63-b7ed-0fe13f35b557 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:14.956338 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-74c2f95e-e42f-4f63-b7ed-0fe13f35b557 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 200 len: 1267 microversion: 2.1 time: 0.152787 Aug 19 21:20:14.956909 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 473/1020] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:14 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:15.977932 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e695079a-9a3d-4a50-a8d6-a4ad9fb1ee4b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:15.978493 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-e695079a-9a3d-4a50-a8d6-a4ad9fb1ee4b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:15.985006 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e695079a-9a3d-4a50-a8d6-a4ad9fb1ee4b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:15.985486 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e695079a-9a3d-4a50-a8d6-a4ad9fb1ee4b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:15.985997 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e695079a-9a3d-4a50-a8d6-a4ad9fb1ee4b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:15.986690 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e695079a-9a3d-4a50-a8d6-a4ad9fb1ee4b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:15.987139 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e695079a-9a3d-4a50-a8d6-a4ad9fb1ee4b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:15.987560 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e695079a-9a3d-4a50-a8d6-a4ad9fb1ee4b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:16.124781 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e695079a-9a3d-4a50-a8d6-a4ad9fb1ee4b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:16.132519 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e695079a-9a3d-4a50-a8d6-a4ad9fb1ee4b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 200 len: 1267 microversion: 2.1 time: 0.158609 Aug 19 21:20:16.133079 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 548/1021] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:15 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:17.155339 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-3745661d-2b49-4ffe-b494-942bed24f963 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:17.155950 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-3745661d-2b49-4ffe-b494-942bed24f963 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:17.162397 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3745661d-2b49-4ffe-b494-942bed24f963 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:17.162881 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3745661d-2b49-4ffe-b494-942bed24f963 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:17.163315 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3745661d-2b49-4ffe-b494-942bed24f963 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:17.164066 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3745661d-2b49-4ffe-b494-942bed24f963 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:17.164513 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3745661d-2b49-4ffe-b494-942bed24f963 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:17.164929 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-3745661d-2b49-4ffe-b494-942bed24f963 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:17.313743 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-3745661d-2b49-4ffe-b494-942bed24f963 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:17.323897 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-3745661d-2b49-4ffe-b494-942bed24f963 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 200 len: 1267 microversion: 2.1 time: 0.173280 Aug 19 21:20:17.324520 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 474/1022] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:17 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:17.328468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-3e840d5f-036b-41fc-b8c7-dbf2afd73760 req-45f0c7ab-7461-4c07-b1e9-0074fa23d2af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67d0593a-5bf1-4f0d-94ac-89589766e987", "name": "network-vif-plugged", "status": "completed", "tag": "6d5e449a-8209-480b-a248-e22d0f1c6658"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:20:17.342198 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-3e840d5f-036b-41fc-b8c7-dbf2afd73760 req-45f0c7ab-7461-4c07-b1e9-0074fa23d2af service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:17.342766 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-3e840d5f-036b-41fc-b8c7-dbf2afd73760 req-45f0c7ab-7461-4c07-b1e9-0074fa23d2af service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:17.343276 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-3e840d5f-036b-41fc-b8c7-dbf2afd73760 req-45f0c7ab-7461-4c07-b1e9-0074fa23d2af service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:17.354582 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-3e840d5f-036b-41fc-b8c7-dbf2afd73760 req-45f0c7ab-7461-4c07-b1e9-0074fa23d2af service nova] Creating event network-vif-plugged:6d5e449a-8209-480b-a248-e22d0f1c6658 for instance 67d0593a-5bf1-4f0d-94ac-89589766e987 on hv-cinder-85220 Aug 19 21:20:17.361195 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-3e840d5f-036b-41fc-b8c7-dbf2afd73760 req-45f0c7ab-7461-4c07-b1e9-0074fa23d2af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036439 Aug 19 21:20:17.361974 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 549/1023] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:20:18.345141 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-910c6db3-6259-4d3f-8c72-a056d6169a9e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:18.345796 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-910c6db3-6259-4d3f-8c72-a056d6169a9e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:18.352094 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-910c6db3-6259-4d3f-8c72-a056d6169a9e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:18.352578 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-910c6db3-6259-4d3f-8c72-a056d6169a9e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:18.353034 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-910c6db3-6259-4d3f-8c72-a056d6169a9e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:18.353731 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-910c6db3-6259-4d3f-8c72-a056d6169a9e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:18.354218 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-910c6db3-6259-4d3f-8c72-a056d6169a9e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:18.354647 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-910c6db3-6259-4d3f-8c72-a056d6169a9e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:18.501118 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-910c6db3-6259-4d3f-8c72-a056d6169a9e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:18.509083 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-910c6db3-6259-4d3f-8c72-a056d6169a9e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 200 len: 1267 microversion: 2.1 time: 0.167957 Aug 19 21:20:18.509650 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 475/1024] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:18 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:19.531710 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ff91a93b-3ee7-4f8b-9360-042d8f5fdda2 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:19.532544 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ff91a93b-3ee7-4f8b-9360-042d8f5fdda2 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:19.539856 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ff91a93b-3ee7-4f8b-9360-042d8f5fdda2 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:19.540419 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ff91a93b-3ee7-4f8b-9360-042d8f5fdda2 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:19.540949 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ff91a93b-3ee7-4f8b-9360-042d8f5fdda2 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:19.541857 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ff91a93b-3ee7-4f8b-9360-042d8f5fdda2 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:19.542288 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ff91a93b-3ee7-4f8b-9360-042d8f5fdda2 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:19.543312 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ff91a93b-3ee7-4f8b-9360-042d8f5fdda2 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:19.691538 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ff91a93b-3ee7-4f8b-9360-042d8f5fdda2 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:19.699438 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ff91a93b-3ee7-4f8b-9360-042d8f5fdda2 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 200 len: 1267 microversion: 2.1 time: 0.172096 Aug 19 21:20:19.700016 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 550/1025] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:19 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:20.720594 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-b99c73eb-e029-40d2-ad98-e8bd876fc21b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:20.721300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-b99c73eb-e029-40d2-ad98-e8bd876fc21b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:20.727945 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b99c73eb-e029-40d2-ad98-e8bd876fc21b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:20.728439 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b99c73eb-e029-40d2-ad98-e8bd876fc21b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:20.729093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b99c73eb-e029-40d2-ad98-e8bd876fc21b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:20.729577 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b99c73eb-e029-40d2-ad98-e8bd876fc21b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:20.730061 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b99c73eb-e029-40d2-ad98-e8bd876fc21b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:20.731011 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b99c73eb-e029-40d2-ad98-e8bd876fc21b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:20.878918 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b99c73eb-e029-40d2-ad98-e8bd876fc21b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:20.888273 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-b99c73eb-e029-40d2-ad98-e8bd876fc21b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 200 len: 1454 microversion: 2.1 time: 0.171530 Aug 19 21:20:20.888850 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 476/1026] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:20 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:20.911573 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-f54a6b7d-7a41-4df1-9fa9-dd6f20247291 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:20.912260 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-f54a6b7d-7a41-4df1-9fa9-dd6f20247291 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:20.920030 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f54a6b7d-7a41-4df1-9fa9-dd6f20247291 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:20.920521 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f54a6b7d-7a41-4df1-9fa9-dd6f20247291 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:20.920952 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f54a6b7d-7a41-4df1-9fa9-dd6f20247291 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:20.921656 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f54a6b7d-7a41-4df1-9fa9-dd6f20247291 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:20.922140 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f54a6b7d-7a41-4df1-9fa9-dd6f20247291 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:20.922664 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f54a6b7d-7a41-4df1-9fa9-dd6f20247291 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:21.067104 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-f54a6b7d-7a41-4df1-9fa9-dd6f20247291 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:21.075406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-f54a6b7d-7a41-4df1-9fa9-dd6f20247291 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 200 len: 1454 microversion: 2.1 time: 0.168865 Aug 19 21:20:21.075976 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 551/1027] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:20 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 1454 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:23.027915 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-0fa4f73f-05ca-4526-bbe5-181b6c4a32bc req-779e1277-0660-4968-bbbb-e56dd28ec273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67d0593a-5bf1-4f0d-94ac-89589766e987", "tag": "6d5e449a-8209-480b-a248-e22d0f1c6658"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:20:23.038066 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-0fa4f73f-05ca-4526-bbe5-181b6c4a32bc req-779e1277-0660-4968-bbbb-e56dd28ec273 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:23.038842 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-0fa4f73f-05ca-4526-bbe5-181b6c4a32bc req-779e1277-0660-4968-bbbb-e56dd28ec273 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:23.039488 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-0fa4f73f-05ca-4526-bbe5-181b6c4a32bc req-779e1277-0660-4968-bbbb-e56dd28ec273 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:23.051513 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-0fa4f73f-05ca-4526-bbe5-181b6c4a32bc req-779e1277-0660-4968-bbbb-e56dd28ec273 service nova] Creating event network-changed:6d5e449a-8209-480b-a248-e22d0f1c6658 for instance 67d0593a-5bf1-4f0d-94ac-89589766e987 on hv-cinder-85220 Aug 19 21:20:23.058590 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-0fa4f73f-05ca-4526-bbe5-181b6c4a32bc req-779e1277-0660-4968-bbbb-e56dd28ec273 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184541 Aug 19 21:20:23.059723 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 477/1028] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:20:38.674879 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-147b7bce-2625-44dd-a3f1-6f7b30eb1210 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1891579708", "imageRef": "d1f034cf-f103-477b-bbb5-3298c678db05", "flavorRef": "452", "networks": [{"uuid": "34882790-5698-455b-8e67-0589dff0b06f"}]}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:20:38.683480 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=19 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:20:38.684137 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=89 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:20:38.730266 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.network.neutron [None req-147b7bce-2625-44dd-a3f1-6f7b30eb1210 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] validate_networks() for [('34882790-5698-455b-8e67-0589dff0b06f', None, None, None, None, None)] {{(pid=120877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 21:20:39.198038 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-147b7bce-2625-44dd-a3f1-6f7b30eb1210 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Flavor limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 21:20:39.198460 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-147b7bce-2625-44dd-a3f1-6f7b30eb1210 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Image limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 21:20:39.198924 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-147b7bce-2625-44dd-a3f1-6f7b30eb1210 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Flavor pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 21:20:39.199325 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-147b7bce-2625-44dd-a3f1-6f7b30eb1210 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Image pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 21:20:39.199726 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-147b7bce-2625-44dd-a3f1-6f7b30eb1210 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 21:20:39.209119 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-147b7bce-2625-44dd-a3f1-6f7b30eb1210 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:39.209594 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-147b7bce-2625-44dd-a3f1-6f7b30eb1210 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:39.210051 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-147b7bce-2625-44dd-a3f1-6f7b30eb1210 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:39.210765 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-147b7bce-2625-44dd-a3f1-6f7b30eb1210 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:39.211218 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-147b7bce-2625-44dd-a3f1-6f7b30eb1210 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:39.211633 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-147b7bce-2625-44dd-a3f1-6f7b30eb1210 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:39.228519 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-147b7bce-2625-44dd-a3f1-6f7b30eb1210 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Getting quotas for project c290ef5d11bd457faab2536a334b9bb7. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:20:39.232540 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-147b7bce-2625-44dd-a3f1-6f7b30eb1210 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Getting quotas for user d96315b58c9e4ed38c97c0d3b50e8069 and project c290ef5d11bd457faab2536a334b9bb7. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:20:39.244573 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-147b7bce-2625-44dd-a3f1-6f7b30eb1210 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Going to run 1 instances... {{(pid=120877) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 21:20:39.249680 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-147b7bce-2625-44dd-a3f1-6f7b30eb1210 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 69cc7341-c516-43ab-8841-87dc277b3a88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f034cf-f103-477b-bbb5-3298c678db05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 21:20:39.318504 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-147b7bce-2625-44dd-a3f1-6f7b30eb1210 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647501 Aug 19 21:20:39.319152 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 552/1029] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Aug 19 21:20:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 21:20:39.328825 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=19 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:20:39.329720 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=67 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:20:39.334074 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-3e5fab30-e1c7-4584-9091-7edb569ac25b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:39.334898 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-3e5fab30-e1c7-4584-9091-7edb569ac25b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 69cc7341-c516-43ab-8841-87dc277b3a88] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:39.393875 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-3e5fab30-e1c7-4584-9091-7edb569ac25b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:39.400743 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-3e5fab30-e1c7-4584-9091-7edb569ac25b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88" status: 200 len: 1219 microversion: 2.1 time: 0.074379 Aug 19 21:20:39.401578 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 478/1030] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:39 2022] GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:40.423276 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-4ca9024b-6edd-4efc-b7e3-d1653c52f226 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:40.423968 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-4ca9024b-6edd-4efc-b7e3-d1653c52f226 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 69cc7341-c516-43ab-8841-87dc277b3a88] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:40.431344 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4ca9024b-6edd-4efc-b7e3-d1653c52f226 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:40.431800 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4ca9024b-6edd-4efc-b7e3-d1653c52f226 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:40.432245 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4ca9024b-6edd-4efc-b7e3-d1653c52f226 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:40.432958 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4ca9024b-6edd-4efc-b7e3-d1653c52f226 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:40.433415 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4ca9024b-6edd-4efc-b7e3-d1653c52f226 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:40.434115 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-4ca9024b-6edd-4efc-b7e3-d1653c52f226 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:40.499608 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-4ca9024b-6edd-4efc-b7e3-d1653c52f226 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:40.507734 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-4ca9024b-6edd-4efc-b7e3-d1653c52f226 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88" status: 200 len: 1277 microversion: 2.1 time: 0.089821 Aug 19 21:20:40.508404 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 553/1031] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:40 2022] GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88 => generated 1277 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:41.490540 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-e6c09b52-aaff-4eb2-8c23-2c7f1946d282 req-30b3de6f-02a4-45e9-80e6-e8afef817f41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69cc7341-c516-43ab-8841-87dc277b3a88", "tag": "2ab58da6-8761-4736-a14b-7830b365d0c4"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:20:41.501631 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-e6c09b52-aaff-4eb2-8c23-2c7f1946d282 req-30b3de6f-02a4-45e9-80e6-e8afef817f41 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:41.502158 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-e6c09b52-aaff-4eb2-8c23-2c7f1946d282 req-30b3de6f-02a4-45e9-80e6-e8afef817f41 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:41.502584 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-e6c09b52-aaff-4eb2-8c23-2c7f1946d282 req-30b3de6f-02a4-45e9-80e6-e8afef817f41 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:41.513431 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-e6c09b52-aaff-4eb2-8c23-2c7f1946d282 req-30b3de6f-02a4-45e9-80e6-e8afef817f41 service nova] Creating event network-changed:2ab58da6-8761-4736-a14b-7830b365d0c4 for instance 69cc7341-c516-43ab-8841-87dc277b3a88 on hv-cinder-85220 Aug 19 21:20:41.519051 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-e6c09b52-aaff-4eb2-8c23-2c7f1946d282 req-30b3de6f-02a4-45e9-80e6-e8afef817f41 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032694 Aug 19 21:20:41.519654 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 479/1032] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:20:41.528781 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-f09d51f9-d0c6-4d5d-9c3b-9a1e8ef83626 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:41.529390 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-f09d51f9-d0c6-4d5d-9c3b-9a1e8ef83626 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 69cc7341-c516-43ab-8841-87dc277b3a88] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:41.536838 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f09d51f9-d0c6-4d5d-9c3b-9a1e8ef83626 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:41.537364 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f09d51f9-d0c6-4d5d-9c3b-9a1e8ef83626 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:41.537826 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f09d51f9-d0c6-4d5d-9c3b-9a1e8ef83626 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:41.538617 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f09d51f9-d0c6-4d5d-9c3b-9a1e8ef83626 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:41.539075 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f09d51f9-d0c6-4d5d-9c3b-9a1e8ef83626 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:41.539502 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f09d51f9-d0c6-4d5d-9c3b-9a1e8ef83626 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:41.672268 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-f09d51f9-d0c6-4d5d-9c3b-9a1e8ef83626 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:41.680529 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-f09d51f9-d0c6-4d5d-9c3b-9a1e8ef83626 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88" status: 200 len: 1319 microversion: 2.1 time: 0.155466 Aug 19 21:20:41.681104 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 554/1033] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:41 2022] GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:42.703667 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-1ebd1676-fefd-4b51-99fa-b5d75c57c38d tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:42.704668 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-1ebd1676-fefd-4b51-99fa-b5d75c57c38d tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 69cc7341-c516-43ab-8841-87dc277b3a88] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:42.710857 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1ebd1676-fefd-4b51-99fa-b5d75c57c38d tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:42.711333 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1ebd1676-fefd-4b51-99fa-b5d75c57c38d tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:42.711759 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1ebd1676-fefd-4b51-99fa-b5d75c57c38d tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:42.712441 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1ebd1676-fefd-4b51-99fa-b5d75c57c38d tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:42.712889 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1ebd1676-fefd-4b51-99fa-b5d75c57c38d tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:42.713312 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1ebd1676-fefd-4b51-99fa-b5d75c57c38d tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:42.845998 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-1ebd1676-fefd-4b51-99fa-b5d75c57c38d tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:42.853752 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-1ebd1676-fefd-4b51-99fa-b5d75c57c38d tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88" status: 200 len: 1319 microversion: 2.1 time: 0.154735 Aug 19 21:20:42.854256 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 480/1034] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:42 2022] GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:43.875769 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a7eeeb61-a7c2-4cfa-80c3-725197236b02 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:43.877146 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-a7eeeb61-a7c2-4cfa-80c3-725197236b02 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 69cc7341-c516-43ab-8841-87dc277b3a88] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:43.883326 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a7eeeb61-a7c2-4cfa-80c3-725197236b02 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:43.884006 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a7eeeb61-a7c2-4cfa-80c3-725197236b02 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:43.884550 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a7eeeb61-a7c2-4cfa-80c3-725197236b02 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:43.885378 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a7eeeb61-a7c2-4cfa-80c3-725197236b02 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:43.885900 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a7eeeb61-a7c2-4cfa-80c3-725197236b02 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:43.886392 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a7eeeb61-a7c2-4cfa-80c3-725197236b02 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:44.029244 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-a7eeeb61-a7c2-4cfa-80c3-725197236b02 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:44.037521 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-a7eeeb61-a7c2-4cfa-80c3-725197236b02 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88" status: 200 len: 1319 microversion: 2.1 time: 0.166987 Aug 19 21:20:44.038128 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 555/1035] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:43 2022] GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:45.059329 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d68916a6-d5d6-473e-acfc-30b89072dc0b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:45.059938 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-d68916a6-d5d6-473e-acfc-30b89072dc0b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 69cc7341-c516-43ab-8841-87dc277b3a88] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:45.067159 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d68916a6-d5d6-473e-acfc-30b89072dc0b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:45.067644 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d68916a6-d5d6-473e-acfc-30b89072dc0b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:45.068076 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d68916a6-d5d6-473e-acfc-30b89072dc0b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:45.068760 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d68916a6-d5d6-473e-acfc-30b89072dc0b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:45.069214 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d68916a6-d5d6-473e-acfc-30b89072dc0b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:45.069637 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d68916a6-d5d6-473e-acfc-30b89072dc0b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:45.205997 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-d68916a6-d5d6-473e-acfc-30b89072dc0b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:45.213950 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-d68916a6-d5d6-473e-acfc-30b89072dc0b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88" status: 200 len: 1319 microversion: 2.1 time: 0.158354 Aug 19 21:20:45.214534 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 481/1036] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:45 2022] GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:46.237134 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-48d93f88-4db2-497e-b8e1-7dffc3116dae tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:46.237724 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-48d93f88-4db2-497e-b8e1-7dffc3116dae tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 69cc7341-c516-43ab-8841-87dc277b3a88] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:46.244714 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-48d93f88-4db2-497e-b8e1-7dffc3116dae tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:46.245275 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-48d93f88-4db2-497e-b8e1-7dffc3116dae tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:46.245713 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-48d93f88-4db2-497e-b8e1-7dffc3116dae tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:46.246469 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-48d93f88-4db2-497e-b8e1-7dffc3116dae tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:46.246922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-48d93f88-4db2-497e-b8e1-7dffc3116dae tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:46.247591 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-48d93f88-4db2-497e-b8e1-7dffc3116dae tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:46.682366 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-48d93f88-4db2-497e-b8e1-7dffc3116dae tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:46.691272 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-48d93f88-4db2-497e-b8e1-7dffc3116dae tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88" status: 200 len: 1319 microversion: 2.1 time: 0.459393 Aug 19 21:20:46.691839 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 556/1037] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:46 2022] GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88 => generated 1319 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:47.480830 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-02a8534b-57a9-46c6-a4d5-0837aff8f569 req-115cb29d-63a2-4e46-9f5b-d8b0017a9892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69cc7341-c516-43ab-8841-87dc277b3a88", "name": "network-vif-plugged", "status": "completed", "tag": "2ab58da6-8761-4736-a14b-7830b365d0c4"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:20:47.491798 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-02a8534b-57a9-46c6-a4d5-0837aff8f569 req-115cb29d-63a2-4e46-9f5b-d8b0017a9892 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:47.492286 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-02a8534b-57a9-46c6-a4d5-0837aff8f569 req-115cb29d-63a2-4e46-9f5b-d8b0017a9892 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:47.492716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-02a8534b-57a9-46c6-a4d5-0837aff8f569 req-115cb29d-63a2-4e46-9f5b-d8b0017a9892 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:47.504862 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-02a8534b-57a9-46c6-a4d5-0837aff8f569 req-115cb29d-63a2-4e46-9f5b-d8b0017a9892 service nova] Creating event network-vif-plugged:2ab58da6-8761-4736-a14b-7830b365d0c4 for instance 69cc7341-c516-43ab-8841-87dc277b3a88 on hv-cinder-85220 Aug 19 21:20:47.509998 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-02a8534b-57a9-46c6-a4d5-0837aff8f569 req-115cb29d-63a2-4e46-9f5b-d8b0017a9892 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034000 Aug 19 21:20:47.510589 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 482/1038] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:20:47.712373 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-de389843-4349-4a90-8c4d-28d1f0a0faef tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:47.713057 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-de389843-4349-4a90-8c4d-28d1f0a0faef tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 69cc7341-c516-43ab-8841-87dc277b3a88] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:47.721198 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-de389843-4349-4a90-8c4d-28d1f0a0faef tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:47.721692 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-de389843-4349-4a90-8c4d-28d1f0a0faef tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:47.722187 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-de389843-4349-4a90-8c4d-28d1f0a0faef tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:47.723069 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-de389843-4349-4a90-8c4d-28d1f0a0faef tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:47.723782 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-de389843-4349-4a90-8c4d-28d1f0a0faef tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:47.724235 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-de389843-4349-4a90-8c4d-28d1f0a0faef tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:47.862209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-de389843-4349-4a90-8c4d-28d1f0a0faef tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:47.870595 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-de389843-4349-4a90-8c4d-28d1f0a0faef tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88" status: 200 len: 1319 microversion: 2.1 time: 0.162051 Aug 19 21:20:47.871188 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 557/1039] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:47 2022] GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:48.954370 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-f69f305d-6d49-440a-b395-7310be254e81 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:48.954993 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-f69f305d-6d49-440a-b395-7310be254e81 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 69cc7341-c516-43ab-8841-87dc277b3a88] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:48.961071 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f69f305d-6d49-440a-b395-7310be254e81 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:48.961549 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f69f305d-6d49-440a-b395-7310be254e81 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:48.962022 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f69f305d-6d49-440a-b395-7310be254e81 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:48.962709 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f69f305d-6d49-440a-b395-7310be254e81 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:48.963183 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f69f305d-6d49-440a-b395-7310be254e81 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:48.963767 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f69f305d-6d49-440a-b395-7310be254e81 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:49.115762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-f69f305d-6d49-440a-b395-7310be254e81 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:49.124076 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-f69f305d-6d49-440a-b395-7310be254e81 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88" status: 200 len: 1319 microversion: 2.1 time: 0.174928 Aug 19 21:20:49.124662 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 483/1040] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:48 2022] GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:20:50.146843 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-d2548911-be6c-41ef-b700-22505142c124 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:20:50.147476 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-d2548911-be6c-41ef-b700-22505142c124 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 69cc7341-c516-43ab-8841-87dc277b3a88] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:20:50.149800 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=2 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:20:50.150475 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=6 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:20:50.158306 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d2548911-be6c-41ef-b700-22505142c124 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:50.159141 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d2548911-be6c-41ef-b700-22505142c124 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:50.159588 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d2548911-be6c-41ef-b700-22505142c124 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:50.160283 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d2548911-be6c-41ef-b700-22505142c124 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:20:50.160731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d2548911-be6c-41ef-b700-22505142c124 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:20:50.161149 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d2548911-be6c-41ef-b700-22505142c124 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:20:50.295224 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-d2548911-be6c-41ef-b700-22505142c124 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:20:50.304473 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-d2548911-be6c-41ef-b700-22505142c124 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88" status: 200 len: 1507 microversion: 2.1 time: 0.161807 Aug 19 21:20:50.305041 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 558/1041] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:20:50 2022] GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:21:14.033858 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-f6ff0afb-7425-472d-ad6f-88119b30bd36 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2285151d-8a19-423c-989d-a34592c1950a", "device": "/dev/sdb"}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:21:14.037569 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-f6ff0afb-7425-472d-ad6f-88119b30bd36 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 69cc7341-c516-43ab-8841-87dc277b3a88] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:21:14.039851 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=2 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:14.040575 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=14 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:14.041279 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=22 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:14.048372 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f6ff0afb-7425-472d-ad6f-88119b30bd36 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:21:14.048864 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f6ff0afb-7425-472d-ad6f-88119b30bd36 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:21:14.049302 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f6ff0afb-7425-472d-ad6f-88119b30bd36 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:21:14.050024 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f6ff0afb-7425-472d-ad6f-88119b30bd36 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:21:14.050497 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f6ff0afb-7425-472d-ad6f-88119b30bd36 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:21:14.051539 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f6ff0afb-7425-472d-ad6f-88119b30bd36 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:21:14.317559 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-f6ff0afb-7425-472d-ad6f-88119b30bd36 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "POST /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287952 Aug 19 21:21:14.318202 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 484/1042] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Aug 19 21:21:14 2022] POST /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:21:41.188956 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8967243d-12cb-44a8-bafe-295530296a54 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:21:41.189514 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8967243d-12cb-44a8-bafe-295530296a54 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 69cc7341-c516-43ab-8841-87dc277b3a88] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:21:41.191633 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:41.192382 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=38 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:41.199244 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8967243d-12cb-44a8-bafe-295530296a54 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:21:41.199731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8967243d-12cb-44a8-bafe-295530296a54 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:21:41.200165 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8967243d-12cb-44a8-bafe-295530296a54 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:21:41.200858 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8967243d-12cb-44a8-bafe-295530296a54 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:21:41.201312 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8967243d-12cb-44a8-bafe-295530296a54 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:21:41.201738 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8967243d-12cb-44a8-bafe-295530296a54 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:21:41.287773 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.objects.instance [None req-8967243d-12cb-44a8-bafe-295530296a54 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lazy-loading 'services' on Instance uuid 69cc7341-c516-43ab-8841-87dc277b3a88 {{(pid=120877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:21:41.362775 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8967243d-12cb-44a8-bafe-295530296a54 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "DELETE /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88/os-volume_attachments/2285151d-8a19-423c-989d-a34592c1950a" status: 202 len: 0 microversion: 2.1 time: 0.177584 Aug 19 21:21:41.363358 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 559/1043] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Aug 19 21:21:41 2022] DELETE /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88/os-volume_attachments/2285151d-8a19-423c-989d-a34592c1950a => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:21:42.482637 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=2 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:42.483428 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:42.487736 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-83cc2980-784a-4a02-a8aa-e6b1646bc4a6 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:21:42.488342 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-83cc2980-784a-4a02-a8aa-e6b1646bc4a6 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 69cc7341-c516-43ab-8841-87dc277b3a88] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:21:42.496195 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-83cc2980-784a-4a02-a8aa-e6b1646bc4a6 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:21:42.496678 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-83cc2980-784a-4a02-a8aa-e6b1646bc4a6 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:21:42.497117 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-83cc2980-784a-4a02-a8aa-e6b1646bc4a6 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:21:42.497840 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-83cc2980-784a-4a02-a8aa-e6b1646bc4a6 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:21:42.498301 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-83cc2980-784a-4a02-a8aa-e6b1646bc4a6 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:21:42.498728 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-83cc2980-784a-4a02-a8aa-e6b1646bc4a6 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:21:42.528529 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-83cc2980-784a-4a02-a8aa-e6b1646bc4a6 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 69cc7341-c516-43ab-8841-87dc277b3a88] Going to try to terminate instance {{(pid=120876) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 21:21:42.609112 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-83cc2980-784a-4a02-a8aa-e6b1646bc4a6 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "DELETE /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88" status: 204 len: 0 microversion: 2.1 time: 0.127737 Aug 19 21:21:42.609905 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 485/1044] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:21:42 2022] DELETE /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 21:21:42.621958 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a3bb979e-d5f3-4d9b-8e33-e2f1465a672e tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:21:42.622702 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-a3bb979e-d5f3-4d9b-8e33-e2f1465a672e tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 69cc7341-c516-43ab-8841-87dc277b3a88] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:21:42.629078 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3bb979e-d5f3-4d9b-8e33-e2f1465a672e tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:21:42.629559 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3bb979e-d5f3-4d9b-8e33-e2f1465a672e tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:21:42.630042 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3bb979e-d5f3-4d9b-8e33-e2f1465a672e tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:21:42.630727 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3bb979e-d5f3-4d9b-8e33-e2f1465a672e tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:21:42.631174 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3bb979e-d5f3-4d9b-8e33-e2f1465a672e tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:21:42.631591 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a3bb979e-d5f3-4d9b-8e33-e2f1465a672e tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:21:42.766386 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-a3bb979e-d5f3-4d9b-8e33-e2f1465a672e tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:21:42.775347 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-a3bb979e-d5f3-4d9b-8e33-e2f1465a672e tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88" status: 200 len: 1513 microversion: 2.1 time: 0.160410 Aug 19 21:21:42.775920 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 560/1045] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:21:42 2022] GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:21:43.797615 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-ba85149f-8f73-4df9-81de-c51dc06d8182 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:21:43.798354 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-ba85149f-8f73-4df9-81de-c51dc06d8182 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 69cc7341-c516-43ab-8841-87dc277b3a88] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:21:43.804809 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ba85149f-8f73-4df9-81de-c51dc06d8182 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:21:43.805292 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ba85149f-8f73-4df9-81de-c51dc06d8182 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:21:43.806515 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ba85149f-8f73-4df9-81de-c51dc06d8182 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:21:43.807282 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ba85149f-8f73-4df9-81de-c51dc06d8182 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:21:43.807745 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ba85149f-8f73-4df9-81de-c51dc06d8182 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:21:43.808163 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-ba85149f-8f73-4df9-81de-c51dc06d8182 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:21:43.943553 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-ba85149f-8f73-4df9-81de-c51dc06d8182 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:21:43.951492 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-ba85149f-8f73-4df9-81de-c51dc06d8182 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88" status: 200 len: 1513 microversion: 2.1 time: 0.158130 Aug 19 21:21:43.952055 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 486/1046] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:21:43 2022] GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:21:44.973104 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e42d3276-09e9-428e-bb0e-284429a5a7ff tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:21:44.973676 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-e42d3276-09e9-428e-bb0e-284429a5a7ff tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 69cc7341-c516-43ab-8841-87dc277b3a88] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:21:44.980508 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e42d3276-09e9-428e-bb0e-284429a5a7ff tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:21:44.981008 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e42d3276-09e9-428e-bb0e-284429a5a7ff tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:21:44.981473 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e42d3276-09e9-428e-bb0e-284429a5a7ff tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:21:44.982198 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e42d3276-09e9-428e-bb0e-284429a5a7ff tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:21:44.982656 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e42d3276-09e9-428e-bb0e-284429a5a7ff tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:21:44.983079 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e42d3276-09e9-428e-bb0e-284429a5a7ff tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:21:45.048008 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e42d3276-09e9-428e-bb0e-284429a5a7ff tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:21:45.056792 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e42d3276-09e9-428e-bb0e-284429a5a7ff tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88" status: 200 len: 1471 microversion: 2.1 time: 0.088006 Aug 19 21:21:45.057481 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 561/1047] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:21:44 2022] GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88 => generated 1471 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:21:45.090032 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-9bd819c5-c84d-479d-bad3-1e3e370fc84e req-083fa6a8-bb78-4428-8d31-9a791e6c94c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69cc7341-c516-43ab-8841-87dc277b3a88", "name": "network-vif-deleted", "tag": "2ab58da6-8761-4736-a14b-7830b365d0c4"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:21:45.101797 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-9bd819c5-c84d-479d-bad3-1e3e370fc84e req-083fa6a8-bb78-4428-8d31-9a791e6c94c9 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:21:45.103250 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-9bd819c5-c84d-479d-bad3-1e3e370fc84e req-083fa6a8-bb78-4428-8d31-9a791e6c94c9 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:21:45.104081 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-9bd819c5-c84d-479d-bad3-1e3e370fc84e req-083fa6a8-bb78-4428-8d31-9a791e6c94c9 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:21:45.115797 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-9bd819c5-c84d-479d-bad3-1e3e370fc84e req-083fa6a8-bb78-4428-8d31-9a791e6c94c9 service nova] Creating event network-vif-deleted:2ab58da6-8761-4736-a14b-7830b365d0c4 for instance 69cc7341-c516-43ab-8841-87dc277b3a88 on hv-cinder-85220 Aug 19 21:21:45.122686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-9bd819c5-c84d-479d-bad3-1e3e370fc84e req-083fa6a8-bb78-4428-8d31-9a791e6c94c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036757 Aug 19 21:21:45.123275 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 487/1048] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:21:46.079344 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a7d60343-0b55-4cf0-92a5-52682142e905 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:21:46.079890 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-a7d60343-0b55-4cf0-92a5-52682142e905 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 69cc7341-c516-43ab-8841-87dc277b3a88] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:21:46.086595 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a7d60343-0b55-4cf0-92a5-52682142e905 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:21:46.087404 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a7d60343-0b55-4cf0-92a5-52682142e905 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:21:46.087833 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a7d60343-0b55-4cf0-92a5-52682142e905 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:21:46.088543 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a7d60343-0b55-4cf0-92a5-52682142e905 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:21:46.088994 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a7d60343-0b55-4cf0-92a5-52682142e905 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:21:46.089881 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a7d60343-0b55-4cf0-92a5-52682142e905 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:21:46.104642 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-a7d60343-0b55-4cf0-92a5-52682142e905 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] HTTP exception thrown: Instance 69cc7341-c516-43ab-8841-87dc277b3a88 could not be found. Aug 19 21:21:46.106305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a7d60343-0b55-4cf0-92a5-52682142e905 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Request method failure captured: Aug 19 21:21:46.106305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88 HTTP/1.1 Aug 19 21:21:46.106305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:21:46.106305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:21:46.106305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:21:46.106305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:21:46.106305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:21:46.106305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:21:46.106305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:21:46.106305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:21:46.106305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__6lU47myxVnxxo7sgtH_wLtmcEtFZMJalluELaF2glbRZ1ItQVaOclFZAZx-B8LOVHmpP_c0S4GVABW51d-XMRjEVVVdbPkR8ldZNOlF0dxdBJdez8SYGel9KiBpboAv8TWO7N4Ime-A4c2SZoBuCaCbgqPXOrHoEMRR9rdQ3e3TaA Aug 19 21:21:46.106305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:21:46.106305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:21:46.106305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:21:46.106305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:21:46.106305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:21:46.106305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:21:46.106305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: c290ef5d11bd457faab2536a334b9bb7 Aug 19 21:21:46.106305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-VolumesSnapshotTestJSON-503779764 Aug 19 21:21:46.106305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:21:46.106305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:21:46.108100 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c290ef5d11bd457faab2536a334b9bb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c290ef5d11bd457faab2536a334b9bb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c290ef5d11bd457faab2536a334b9bb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c290ef5d11bd457faab2536a334b9bb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:21:46.108100 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-VolumesSnapshotTestJSON-503779764 Aug 19 21:21:46.108100 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: c290ef5d11bd457faab2536a334b9bb7 Aug 19 21:21:46.108100 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-503779764 Aug 19 21:21:46.108100 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-VolumesSnapshotTestJSON-503779764-project Aug 19 21:21:46.108100 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:21:46.108100 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:21:46.108100 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: d96315b58c9e4ed38c97c0d3b50e8069 Aug 19 21:21:46.108100 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-VolumesSnapshotTestJSON-503779764-project Aug 19 21:21:46.108100 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: > Aug 19 21:21:46.108100 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Instance 69cc7341-c516-43ab-8841-87dc277b3a88 could not be found. Aug 19 21:21:46.108100 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'id': '69cc7341-c516-43ab-8841-87dc277b3a88'} Aug 19 21:21:46.109237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:21:46.109237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:21:46.109237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:21:46.109237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:21:46.109237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:21:46.109237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:21:46.109237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:21:46.109237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:21:46.109237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:21:46.109237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:21:46.109237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69cc7341-c516-43ab-8841-87dc277b3a88 could not be found. Aug 19 21:21:46.109237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:21:46.109237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:21:46.109237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:21:46.109237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:21:46.109237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:21:46.109237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:21:46.109237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:21:46.109237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:21:46.109237 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:21:46.110965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:21:46.110965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:21:46.110965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:21:46.110965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:21:46.110965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:21:46.110965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:21:46.110965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:21:46.110965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69cc7341-c516-43ab-8841-87dc277b3a88 could not be found. Aug 19 21:21:46.110965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:21:46.110965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:21:46.110965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:21:46.110965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:21:46.110965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:21:46.110965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:21:46.110965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:21:46.110965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:21:46.110965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69cc7341-c516-43ab-8841-87dc277b3a88 could not be found. Aug 19 21:21:46.110965 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:21:46.112667 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a7d60343-0b55-4cf0-92a5-52682142e905 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Returning 404 to user: Instance 69cc7341-c516-43ab-8841-87dc277b3a88 could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:21:46.112667 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-a7d60343-0b55-4cf0-92a5-52682142e905 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88" status: 404 len: 111 microversion: 2.1 time: 0.032675 Aug 19 21:21:46.112667 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 562/1049] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:21:46 2022] GET /compute/v2.1/servers/69cc7341-c516-43ab-8841-87dc277b3a88 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:21:57.015270 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-006ef236-ee38-469f-871c-58b5d5e7a76b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-860567356", "imageRef": "d1f034cf-f103-477b-bbb5-3298c678db05", "flavorRef": "452", "networks": [{"uuid": "34882790-5698-455b-8e67-0589dff0b06f"}]}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:21:57.024761 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:57.025423 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:57.077461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.network.neutron [None req-006ef236-ee38-469f-871c-58b5d5e7a76b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] validate_networks() for [('34882790-5698-455b-8e67-0589dff0b06f', None, None, None, None, None)] {{(pid=120876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 21:21:57.210440 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 21:21:57.211052 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Fri Aug 19 21:21:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Aug 19 21:21:57.481002 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-006ef236-ee38-469f-871c-58b5d5e7a76b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Flavor limits 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 21:21:57.481455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-006ef236-ee38-469f-871c-58b5d5e7a76b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Image limits 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 21:21:57.481966 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-006ef236-ee38-469f-871c-58b5d5e7a76b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Flavor pref 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 21:21:57.482378 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-006ef236-ee38-469f-871c-58b5d5e7a76b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Image pref 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 21:21:57.482785 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-006ef236-ee38-469f-871c-58b5d5e7a76b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 21:21:57.492070 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-006ef236-ee38-469f-871c-58b5d5e7a76b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:21:57.492551 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-006ef236-ee38-469f-871c-58b5d5e7a76b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:21:57.492983 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-006ef236-ee38-469f-871c-58b5d5e7a76b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:21:57.493706 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-006ef236-ee38-469f-871c-58b5d5e7a76b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:21:57.494214 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-006ef236-ee38-469f-871c-58b5d5e7a76b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:21:57.495343 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-006ef236-ee38-469f-871c-58b5d5e7a76b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:21:57.512872 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-006ef236-ee38-469f-871c-58b5d5e7a76b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Getting quotas for project c290ef5d11bd457faab2536a334b9bb7. Resources: {'cores', 'ram', 'instances'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:21:57.516905 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-006ef236-ee38-469f-871c-58b5d5e7a76b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Getting quotas for user d96315b58c9e4ed38c97c0d3b50e8069 and project c290ef5d11bd457faab2536a334b9bb7. Resources: {'cores', 'ram', 'instances'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:21:57.528845 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-006ef236-ee38-469f-871c-58b5d5e7a76b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Going to run 1 instances... {{(pid=120876) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 21:21:57.531221 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-006ef236-ee38-469f-871c-58b5d5e7a76b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 43c91efd-bd6f-4533-bc09-1dcd3d9d2591] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f034cf-f103-477b-bbb5-3298c678db05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 21:21:57.580609 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-006ef236-ee38-469f-871c-58b5d5e7a76b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570632 Aug 19 21:21:57.581262 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 488/1050] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Aug 19 21:21:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 21:21:57.593693 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-b06d6ba0-9426-4165-bb2a-bac629fb696b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:21:57.594440 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-b06d6ba0-9426-4165-bb2a-bac629fb696b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 43c91efd-bd6f-4533-bc09-1dcd3d9d2591] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:21:57.596884 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=8 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:57.597530 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:21:57.656113 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-b06d6ba0-9426-4165-bb2a-bac629fb696b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:21:57.663060 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-b06d6ba0-9426-4165-bb2a-bac629fb696b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591" status: 200 len: 1218 microversion: 2.1 time: 0.073610 Aug 19 21:21:57.663715 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 563/1051] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:21:57 2022] GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:21:58.685574 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-9b7d3c95-02cd-4a9a-ad62-638b1defd3d3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:21:58.686339 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-9b7d3c95-02cd-4a9a-ad62-638b1defd3d3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 43c91efd-bd6f-4533-bc09-1dcd3d9d2591] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:21:58.693658 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9b7d3c95-02cd-4a9a-ad62-638b1defd3d3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:21:58.694216 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9b7d3c95-02cd-4a9a-ad62-638b1defd3d3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:21:58.694645 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9b7d3c95-02cd-4a9a-ad62-638b1defd3d3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:21:58.695366 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9b7d3c95-02cd-4a9a-ad62-638b1defd3d3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:21:58.695810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9b7d3c95-02cd-4a9a-ad62-638b1defd3d3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:21:58.696227 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9b7d3c95-02cd-4a9a-ad62-638b1defd3d3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:21:58.763777 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9b7d3c95-02cd-4a9a-ad62-638b1defd3d3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:21:58.772160 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-9b7d3c95-02cd-4a9a-ad62-638b1defd3d3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591" status: 200 len: 1276 microversion: 2.1 time: 0.091271 Aug 19 21:21:58.772734 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 489/1052] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:21:58 2022] GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591 => generated 1276 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:21:59.792696 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a48c2834-2ca4-4744-8aa1-06d09859eefe tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:21:59.793311 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-a48c2834-2ca4-4744-8aa1-06d09859eefe tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 43c91efd-bd6f-4533-bc09-1dcd3d9d2591] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:21:59.800772 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a48c2834-2ca4-4744-8aa1-06d09859eefe tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:21:59.801313 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a48c2834-2ca4-4744-8aa1-06d09859eefe tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:21:59.801754 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a48c2834-2ca4-4744-8aa1-06d09859eefe tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:21:59.802480 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a48c2834-2ca4-4744-8aa1-06d09859eefe tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:21:59.802933 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a48c2834-2ca4-4744-8aa1-06d09859eefe tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:21:59.803355 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a48c2834-2ca4-4744-8aa1-06d09859eefe tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:21:59.935783 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-a48c2834-2ca4-4744-8aa1-06d09859eefe tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:21:59.943393 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-a48c2834-2ca4-4744-8aa1-06d09859eefe tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591" status: 200 len: 1318 microversion: 2.1 time: 0.154784 Aug 19 21:21:59.943955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 564/1053] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:21:59 2022] GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:21:59.986259 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-431898f1-1417-4e66-924c-ecae0721da86 req-f2213569-e295-4a47-9657-82ee7034d442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43c91efd-bd6f-4533-bc09-1dcd3d9d2591", "tag": "5c45e7b5-6d1c-4bde-9486-534d19d20608"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:21:59.997242 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-431898f1-1417-4e66-924c-ecae0721da86 req-f2213569-e295-4a47-9657-82ee7034d442 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:21:59.997725 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-431898f1-1417-4e66-924c-ecae0721da86 req-f2213569-e295-4a47-9657-82ee7034d442 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:21:59.998416 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-431898f1-1417-4e66-924c-ecae0721da86 req-f2213569-e295-4a47-9657-82ee7034d442 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:00.009748 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-431898f1-1417-4e66-924c-ecae0721da86 req-f2213569-e295-4a47-9657-82ee7034d442 service nova] Creating event network-changed:5c45e7b5-6d1c-4bde-9486-534d19d20608 for instance 43c91efd-bd6f-4533-bc09-1dcd3d9d2591 on hv-cinder-85220 Aug 19 21:22:00.015006 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-431898f1-1417-4e66-924c-ecae0721da86 req-f2213569-e295-4a47-9657-82ee7034d442 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032984 Aug 19 21:22:00.015615 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 490/1054] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:22:00.964158 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-2eb3f70e-3054-4404-89d2-295ab68594f3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:22:00.964768 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-2eb3f70e-3054-4404-89d2-295ab68594f3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 43c91efd-bd6f-4533-bc09-1dcd3d9d2591] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:22:00.971204 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2eb3f70e-3054-4404-89d2-295ab68594f3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:00.971689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2eb3f70e-3054-4404-89d2-295ab68594f3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:00.972124 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2eb3f70e-3054-4404-89d2-295ab68594f3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:00.972823 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2eb3f70e-3054-4404-89d2-295ab68594f3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:00.973286 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2eb3f70e-3054-4404-89d2-295ab68594f3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:00.973744 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2eb3f70e-3054-4404-89d2-295ab68594f3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:01.109360 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-2eb3f70e-3054-4404-89d2-295ab68594f3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:22:01.117027 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-2eb3f70e-3054-4404-89d2-295ab68594f3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591" status: 200 len: 1318 microversion: 2.1 time: 0.156816 Aug 19 21:22:01.117607 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 565/1055] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:22:00 2022] GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:22:02.140425 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-9cad3e91-0693-426c-b742-3d2356cff80b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:22:02.141126 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-9cad3e91-0693-426c-b742-3d2356cff80b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 43c91efd-bd6f-4533-bc09-1dcd3d9d2591] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:22:02.147797 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9cad3e91-0693-426c-b742-3d2356cff80b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:02.148279 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9cad3e91-0693-426c-b742-3d2356cff80b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:02.148712 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9cad3e91-0693-426c-b742-3d2356cff80b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:02.149394 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9cad3e91-0693-426c-b742-3d2356cff80b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:02.149878 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9cad3e91-0693-426c-b742-3d2356cff80b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:02.150300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9cad3e91-0693-426c-b742-3d2356cff80b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:02.291219 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9cad3e91-0693-426c-b742-3d2356cff80b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:22:02.299104 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-9cad3e91-0693-426c-b742-3d2356cff80b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591" status: 200 len: 1318 microversion: 2.1 time: 0.164011 Aug 19 21:22:02.299667 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 491/1056] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:22:02 2022] GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:22:03.320222 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-58b1a828-97d1-41ac-bed5-eee161589afb tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:22:03.320822 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-58b1a828-97d1-41ac-bed5-eee161589afb tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 43c91efd-bd6f-4533-bc09-1dcd3d9d2591] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:22:03.328115 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58b1a828-97d1-41ac-bed5-eee161589afb tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:03.328594 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58b1a828-97d1-41ac-bed5-eee161589afb tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:03.329022 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58b1a828-97d1-41ac-bed5-eee161589afb tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:03.329710 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58b1a828-97d1-41ac-bed5-eee161589afb tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:03.330297 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58b1a828-97d1-41ac-bed5-eee161589afb tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:03.330715 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-58b1a828-97d1-41ac-bed5-eee161589afb tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:03.459889 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-58b1a828-97d1-41ac-bed5-eee161589afb tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:22:03.468290 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-58b1a828-97d1-41ac-bed5-eee161589afb tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591" status: 200 len: 1318 microversion: 2.1 time: 0.151983 Aug 19 21:22:03.468859 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 566/1057] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:22:03 2022] GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:22:04.488781 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-7863760e-2671-4bea-9075-d6f89a6d795f tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:22:04.489397 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-7863760e-2671-4bea-9075-d6f89a6d795f tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 43c91efd-bd6f-4533-bc09-1dcd3d9d2591] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:22:04.496601 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7863760e-2671-4bea-9075-d6f89a6d795f tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:04.497144 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7863760e-2671-4bea-9075-d6f89a6d795f tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:04.497614 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7863760e-2671-4bea-9075-d6f89a6d795f tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:04.498374 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7863760e-2671-4bea-9075-d6f89a6d795f tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:04.498871 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7863760e-2671-4bea-9075-d6f89a6d795f tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:04.499330 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7863760e-2671-4bea-9075-d6f89a6d795f tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:04.638461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-7863760e-2671-4bea-9075-d6f89a6d795f tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:22:04.646421 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-7863760e-2671-4bea-9075-d6f89a6d795f tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591" status: 200 len: 1318 microversion: 2.1 time: 0.161487 Aug 19 21:22:04.646977 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 492/1058] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:22:04 2022] GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:22:05.668316 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-f4574273-46c0-43e5-8974-b14e29a29fa6 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:22:05.668916 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-f4574273-46c0-43e5-8974-b14e29a29fa6 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 43c91efd-bd6f-4533-bc09-1dcd3d9d2591] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:22:05.675661 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f4574273-46c0-43e5-8974-b14e29a29fa6 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:05.675844 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f4574273-46c0-43e5-8974-b14e29a29fa6 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:05.676197 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f4574273-46c0-43e5-8974-b14e29a29fa6 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:05.676880 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f4574273-46c0-43e5-8974-b14e29a29fa6 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:05.677327 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f4574273-46c0-43e5-8974-b14e29a29fa6 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:05.677749 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f4574273-46c0-43e5-8974-b14e29a29fa6 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:05.810817 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-f4574273-46c0-43e5-8974-b14e29a29fa6 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:22:05.818673 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-f4574273-46c0-43e5-8974-b14e29a29fa6 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591" status: 200 len: 1318 microversion: 2.1 time: 0.154521 Aug 19 21:22:05.819251 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 567/1059] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:22:05 2022] GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:22:05.916515 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-011836f0-8f21-4a3c-9aa9-9af75b83d3a8 req-ad8beecd-6fd5-4eac-b37e-bbeaf7814dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43c91efd-bd6f-4533-bc09-1dcd3d9d2591", "name": "network-vif-plugged", "status": "completed", "tag": "5c45e7b5-6d1c-4bde-9486-534d19d20608"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:22:05.928264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-011836f0-8f21-4a3c-9aa9-9af75b83d3a8 req-ad8beecd-6fd5-4eac-b37e-bbeaf7814dcf service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:05.928750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-011836f0-8f21-4a3c-9aa9-9af75b83d3a8 req-ad8beecd-6fd5-4eac-b37e-bbeaf7814dcf service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:05.929181 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-011836f0-8f21-4a3c-9aa9-9af75b83d3a8 req-ad8beecd-6fd5-4eac-b37e-bbeaf7814dcf service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:05.941360 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-011836f0-8f21-4a3c-9aa9-9af75b83d3a8 req-ad8beecd-6fd5-4eac-b37e-bbeaf7814dcf service nova] Creating event network-vif-plugged:5c45e7b5-6d1c-4bde-9486-534d19d20608 for instance 43c91efd-bd6f-4533-bc09-1dcd3d9d2591 on hv-cinder-85220 Aug 19 21:22:05.946347 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-011836f0-8f21-4a3c-9aa9-9af75b83d3a8 req-ad8beecd-6fd5-4eac-b37e-bbeaf7814dcf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033908 Aug 19 21:22:05.946940 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 493/1060] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:22:06.841594 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3ba69899-e158-4c62-8323-b113e65f3cd9 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:22:06.842240 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-3ba69899-e158-4c62-8323-b113e65f3cd9 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 43c91efd-bd6f-4533-bc09-1dcd3d9d2591] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:22:06.848667 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3ba69899-e158-4c62-8323-b113e65f3cd9 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:06.849150 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3ba69899-e158-4c62-8323-b113e65f3cd9 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:06.849589 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3ba69899-e158-4c62-8323-b113e65f3cd9 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:06.850310 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3ba69899-e158-4c62-8323-b113e65f3cd9 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:06.850767 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3ba69899-e158-4c62-8323-b113e65f3cd9 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:06.851190 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-3ba69899-e158-4c62-8323-b113e65f3cd9 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:06.986839 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-3ba69899-e158-4c62-8323-b113e65f3cd9 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:22:06.995031 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-3ba69899-e158-4c62-8323-b113e65f3cd9 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591" status: 200 len: 1318 microversion: 2.1 time: 0.157915 Aug 19 21:22:06.995627 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 568/1061] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:22:06 2022] GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:22:07.096315 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 21:22:07.096500 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Fri Aug 19 21:22:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 21:22:08.013577 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=2 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:22:08.014382 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=6 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:22:08.018826 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-c31a0546-706f-45f3-9a06-fe7d52985704 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:22:08.019526 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-c31a0546-706f-45f3-9a06-fe7d52985704 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 43c91efd-bd6f-4533-bc09-1dcd3d9d2591] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:22:08.027818 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c31a0546-706f-45f3-9a06-fe7d52985704 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:08.028315 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c31a0546-706f-45f3-9a06-fe7d52985704 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:08.028765 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c31a0546-706f-45f3-9a06-fe7d52985704 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:08.029461 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c31a0546-706f-45f3-9a06-fe7d52985704 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:08.029946 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c31a0546-706f-45f3-9a06-fe7d52985704 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:08.030402 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c31a0546-706f-45f3-9a06-fe7d52985704 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:08.167226 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-c31a0546-706f-45f3-9a06-fe7d52985704 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:22:08.175801 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-c31a0546-706f-45f3-9a06-fe7d52985704 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591" status: 200 len: 1506 microversion: 2.1 time: 0.163547 Aug 19 21:22:08.176435 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 494/1062] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:22:08 2022] GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:22:08.199130 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-5d7194fb-1abb-47f6-b5bf-e61cf37b8bd3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7254b717-01d8-45d2-bf67-09bb1765b605", "device": "/dev/sdb"}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:22:08.202310 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-5d7194fb-1abb-47f6-b5bf-e61cf37b8bd3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 43c91efd-bd6f-4533-bc09-1dcd3d9d2591] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:22:08.204400 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=2 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:22:08.210580 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5d7194fb-1abb-47f6-b5bf-e61cf37b8bd3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:08.211076 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5d7194fb-1abb-47f6-b5bf-e61cf37b8bd3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:08.211511 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5d7194fb-1abb-47f6-b5bf-e61cf37b8bd3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:08.212222 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5d7194fb-1abb-47f6-b5bf-e61cf37b8bd3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:08.212674 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5d7194fb-1abb-47f6-b5bf-e61cf37b8bd3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:08.213136 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5d7194fb-1abb-47f6-b5bf-e61cf37b8bd3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:08.471095 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-5d7194fb-1abb-47f6-b5bf-e61cf37b8bd3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "POST /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276826 Aug 19 21:22:08.471779 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 569/1063] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Aug 19 21:22:08 2022] POST /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:22:13.831149 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-7e79df46-b2cd-4d23-8c1f-b38d80aefd77 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:22:13.831690 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-7e79df46-b2cd-4d23-8c1f-b38d80aefd77 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:22:13.835242 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-70dec675-163a-4301-98d6-abf2feaeed85 req-ba31f4c1-5d2f-488a-ad18-7297013d2eac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84087b72-4e56-413e-b975-c23f9f79d0d0", "tag": "702f349d-7673-4c52-a88b-8c4ef8a04aa4"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:22:13.838832 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7e79df46-b2cd-4d23-8c1f-b38d80aefd77 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:13.839324 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7e79df46-b2cd-4d23-8c1f-b38d80aefd77 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:13.839756 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7e79df46-b2cd-4d23-8c1f-b38d80aefd77 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:13.840613 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7e79df46-b2cd-4d23-8c1f-b38d80aefd77 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:13.841240 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7e79df46-b2cd-4d23-8c1f-b38d80aefd77 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:13.841883 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7e79df46-b2cd-4d23-8c1f-b38d80aefd77 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:13.845955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-70dec675-163a-4301-98d6-abf2feaeed85 req-ba31f4c1-5d2f-488a-ad18-7297013d2eac service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:13.846425 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-70dec675-163a-4301-98d6-abf2feaeed85 req-ba31f4c1-5d2f-488a-ad18-7297013d2eac service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:13.846856 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-70dec675-163a-4301-98d6-abf2feaeed85 req-ba31f4c1-5d2f-488a-ad18-7297013d2eac service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:13.859211 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-70dec675-163a-4301-98d6-abf2feaeed85 req-ba31f4c1-5d2f-488a-ad18-7297013d2eac service nova] Creating event network-changed:702f349d-7673-4c52-a88b-8c4ef8a04aa4 for instance 84087b72-4e56-413e-b975-c23f9f79d0d0 on hv-cinder-85220 Aug 19 21:22:13.864891 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-70dec675-163a-4301-98d6-abf2feaeed85 req-ba31f4c1-5d2f-488a-ad18-7297013d2eac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034952 Aug 19 21:22:13.865704 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 570/1064] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:22:13.872458 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-7e79df46-b2cd-4d23-8c1f-b38d80aefd77 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Going to try to terminate instance {{(pid=120876) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 21:22:13.961641 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-7e79df46-b2cd-4d23-8c1f-b38d80aefd77 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "DELETE /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 204 len: 0 microversion: 2.1 time: 0.134128 Aug 19 21:22:13.962265 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 495/1065] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:22:13 2022] DELETE /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 21:22:13.974588 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-b875ab1f-e5f7-481d-9b71-3cf12416a861 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:22:13.975299 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-b875ab1f-e5f7-481d-9b71-3cf12416a861 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:22:13.981998 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b875ab1f-e5f7-481d-9b71-3cf12416a861 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:13.982523 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b875ab1f-e5f7-481d-9b71-3cf12416a861 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:13.982927 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b875ab1f-e5f7-481d-9b71-3cf12416a861 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:13.983629 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b875ab1f-e5f7-481d-9b71-3cf12416a861 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:13.984087 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b875ab1f-e5f7-481d-9b71-3cf12416a861 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:13.984518 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b875ab1f-e5f7-481d-9b71-3cf12416a861 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:14.132561 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-b875ab1f-e5f7-481d-9b71-3cf12416a861 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:22:14.143085 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-b875ab1f-e5f7-481d-9b71-3cf12416a861 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1566 microversion: 2.1 time: 0.172669 Aug 19 21:22:14.143677 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 571/1066] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:22:13 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:22:15.165257 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-9f7a70d8-bf3e-4af5-b96b-6e8c862d5411 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:22:15.166505 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-9f7a70d8-bf3e-4af5-b96b-6e8c862d5411 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:22:15.173381 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9f7a70d8-bf3e-4af5-b96b-6e8c862d5411 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:15.173894 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9f7a70d8-bf3e-4af5-b96b-6e8c862d5411 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:15.174329 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9f7a70d8-bf3e-4af5-b96b-6e8c862d5411 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:15.175005 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9f7a70d8-bf3e-4af5-b96b-6e8c862d5411 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:15.175450 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9f7a70d8-bf3e-4af5-b96b-6e8c862d5411 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:15.175863 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9f7a70d8-bf3e-4af5-b96b-6e8c862d5411 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:15.320566 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9f7a70d8-bf3e-4af5-b96b-6e8c862d5411 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:22:15.328537 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-9f7a70d8-bf3e-4af5-b96b-6e8c862d5411 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1566 microversion: 2.1 time: 0.167587 Aug 19 21:22:15.329120 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 496/1067] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:22:15 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:22:16.351891 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-2a3d2cc8-3334-4f9c-917d-837d73309904 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:22:16.354523 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-2a3d2cc8-3334-4f9c-917d-837d73309904 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:22:16.366806 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2a3d2cc8-3334-4f9c-917d-837d73309904 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:16.367968 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2a3d2cc8-3334-4f9c-917d-837d73309904 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:16.368984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2a3d2cc8-3334-4f9c-917d-837d73309904 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:16.371582 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2a3d2cc8-3334-4f9c-917d-837d73309904 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:16.372592 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2a3d2cc8-3334-4f9c-917d-837d73309904 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:16.373743 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-2a3d2cc8-3334-4f9c-917d-837d73309904 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:16.636669 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-2a3d2cc8-3334-4f9c-917d-837d73309904 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:22:16.645516 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-2a3d2cc8-3334-4f9c-917d-837d73309904 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1566 microversion: 2.1 time: 0.299027 Aug 19 21:22:16.646117 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 572/1068] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:22:16 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1566 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:22:16.949066 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-a5f1c116-b940-4e87-8a21-991d5aafd12f req-54b58753-988b-422c-90cb-f524117097ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84087b72-4e56-413e-b975-c23f9f79d0d0", "name": "network-vif-deleted", "tag": "702f349d-7673-4c52-a88b-8c4ef8a04aa4"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:22:16.960770 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-a5f1c116-b940-4e87-8a21-991d5aafd12f req-54b58753-988b-422c-90cb-f524117097ef service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:16.961249 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-a5f1c116-b940-4e87-8a21-991d5aafd12f req-54b58753-988b-422c-90cb-f524117097ef service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:16.961821 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-a5f1c116-b940-4e87-8a21-991d5aafd12f req-54b58753-988b-422c-90cb-f524117097ef service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:16.979271 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-a5f1c116-b940-4e87-8a21-991d5aafd12f req-54b58753-988b-422c-90cb-f524117097ef service nova] Creating event network-vif-deleted:702f349d-7673-4c52-a88b-8c4ef8a04aa4 for instance 84087b72-4e56-413e-b975-c23f9f79d0d0 on hv-cinder-85220 Aug 19 21:22:16.986411 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-a5f1c116-b940-4e87-8a21-991d5aafd12f req-54b58753-988b-422c-90cb-f524117097ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041951 Aug 19 21:22:16.987014 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 497/1069] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:22:17.667483 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-1041257e-a6e9-408b-8fd3-d28f9a8f79df tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:22:17.668028 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-1041257e-a6e9-408b-8fd3-d28f9a8f79df tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:22:17.674469 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1041257e-a6e9-408b-8fd3-d28f9a8f79df tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:17.674977 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1041257e-a6e9-408b-8fd3-d28f9a8f79df tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:17.675408 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1041257e-a6e9-408b-8fd3-d28f9a8f79df tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:17.676086 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1041257e-a6e9-408b-8fd3-d28f9a8f79df tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:17.676531 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1041257e-a6e9-408b-8fd3-d28f9a8f79df tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:17.676947 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1041257e-a6e9-408b-8fd3-d28f9a8f79df tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:17.711668 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1041257e-a6e9-408b-8fd3-d28f9a8f79df tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:17.712136 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1041257e-a6e9-408b-8fd3-d28f9a8f79df tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:17.712562 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-1041257e-a6e9-408b-8fd3-d28f9a8f79df tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:17.713132 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.objects.instance [None req-1041257e-a6e9-408b-8fd3-d28f9a8f79df tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lazy-loading 'fault' on Instance uuid 84087b72-4e56-413e-b975-c23f9f79d0d0 {{(pid=120877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:22:17.754454 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-1041257e-a6e9-408b-8fd3-d28f9a8f79df tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:22:17.762638 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-1041257e-a6e9-408b-8fd3-d28f9a8f79df tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1223 microversion: 2.1 time: 0.099920 Aug 19 21:22:17.763223 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 573/1070] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:22:17 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:22:18.786761 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-2dbc53a8-8b87-45c5-b204-ddfb8604c4bd tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:22:18.787455 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-2dbc53a8-8b87-45c5-b204-ddfb8604c4bd tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:22:18.795457 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2dbc53a8-8b87-45c5-b204-ddfb8604c4bd tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:18.795937 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2dbc53a8-8b87-45c5-b204-ddfb8604c4bd tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:18.796364 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2dbc53a8-8b87-45c5-b204-ddfb8604c4bd tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:18.797143 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2dbc53a8-8b87-45c5-b204-ddfb8604c4bd tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:18.797595 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2dbc53a8-8b87-45c5-b204-ddfb8604c4bd tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:18.798043 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2dbc53a8-8b87-45c5-b204-ddfb8604c4bd tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:18.832156 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2dbc53a8-8b87-45c5-b204-ddfb8604c4bd tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:18.832633 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2dbc53a8-8b87-45c5-b204-ddfb8604c4bd tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:18.833055 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-2dbc53a8-8b87-45c5-b204-ddfb8604c4bd tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:18.833487 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.objects.instance [None req-2dbc53a8-8b87-45c5-b204-ddfb8604c4bd tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lazy-loading 'fault' on Instance uuid 84087b72-4e56-413e-b975-c23f9f79d0d0 {{(pid=120876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:22:18.877963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-2dbc53a8-8b87-45c5-b204-ddfb8604c4bd tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed8b3dc88c4fadbb0839fd848397d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d769840e964ef5923aa9c28265be03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:22:18.886585 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-2dbc53a8-8b87-45c5-b204-ddfb8604c4bd tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 200 len: 1223 microversion: 2.1 time: 0.103958 Aug 19 21:22:18.887148 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 498/1071] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:22:18 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:22:19.907956 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c519f7f0-10be-4a32-98a0-f0fd12cc33a7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:22:19.908565 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-c519f7f0-10be-4a32-98a0-f0fd12cc33a7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] [instance: 84087b72-4e56-413e-b975-c23f9f79d0d0] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:22:19.915133 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c519f7f0-10be-4a32-98a0-f0fd12cc33a7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:19.915619 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c519f7f0-10be-4a32-98a0-f0fd12cc33a7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:19.916076 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c519f7f0-10be-4a32-98a0-f0fd12cc33a7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:19.916805 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c519f7f0-10be-4a32-98a0-f0fd12cc33a7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:19.917260 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c519f7f0-10be-4a32-98a0-f0fd12cc33a7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:19.917689 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c519f7f0-10be-4a32-98a0-f0fd12cc33a7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:19.931138 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-c519f7f0-10be-4a32-98a0-f0fd12cc33a7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] HTTP exception thrown: Instance 84087b72-4e56-413e-b975-c23f9f79d0d0 could not be found. Aug 19 21:22:19.932819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c519f7f0-10be-4a32-98a0-f0fd12cc33a7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Request method failure captured: Aug 19 21:22:19.932819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 HTTP/1.1 Aug 19 21:22:19.932819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:22:19.932819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:22:19.932819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:22:19.932819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:22:19.932819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:22:19.932819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:22:19.932819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:22:19.932819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:22:19.932819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__2Bj_Bw7La0Uc2oiHh-INqdY48BDydsMIp4usqML6XbfJ79GuPQJ7w3aCOJF-4UkDY2orwPKUUrCqgQ_NfnVk-cvMsQJxERWvF7sUWugB8lNrLqfa8fJWDnJPqd2MQVY8foYs1-8o5zhsPlrteUbxedO53jTd6CmqrP62pKPFZ848s Aug 19 21:22:19.932819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:22:19.932819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:22:19.932819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:22:19.932819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:22:19.932819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:22:19.932819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:22:19.932819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: b8d769840e964ef5923aa9c28265be03 Aug 19 21:22:19.932819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-TestShelveInstance-663893316 Aug 19 21:22:19.932819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:22:19.932819 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:22:19.934570 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b8d769840e964ef5923aa9c28265be03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b8d769840e964ef5923aa9c28265be03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b8d769840e964ef5923aa9c28265be03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b8d769840e964ef5923aa9c28265be03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:22:19.934570 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-TestShelveInstance-663893316 Aug 19 21:22:19.934570 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: b8d769840e964ef5923aa9c28265be03 Aug 19 21:22:19.934570 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-TestShelveInstance-663893316 Aug 19 21:22:19.934570 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-TestShelveInstance-663893316-project Aug 19 21:22:19.934570 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:22:19.934570 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:22:19.934570 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: f7ed8b3dc88c4fadbb0839fd848397d1 Aug 19 21:22:19.934570 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-TestShelveInstance-663893316-project Aug 19 21:22:19.934570 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: > Aug 19 21:22:19.934570 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Instance 84087b72-4e56-413e-b975-c23f9f79d0d0 could not be found. Aug 19 21:22:19.934570 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'id': '84087b72-4e56-413e-b975-c23f9f79d0d0'} Aug 19 21:22:19.935554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:22:19.935554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:22:19.935554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:22:19.935554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:22:19.935554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:22:19.935554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:22:19.935554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:22:19.935554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:22:19.935554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:22:19.935554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:22:19.935554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84087b72-4e56-413e-b975-c23f9f79d0d0 could not be found. Aug 19 21:22:19.935554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:22:19.935554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:22:19.935554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:22:19.935554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:22:19.935554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:22:19.935554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:22:19.935554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:22:19.935554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:22:19.935554 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:22:19.937563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:22:19.937563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:22:19.937563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:22:19.937563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:22:19.937563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:22:19.937563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:22:19.937563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:22:19.937563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84087b72-4e56-413e-b975-c23f9f79d0d0 could not be found. Aug 19 21:22:19.937563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:22:19.937563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:22:19.937563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:22:19.937563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:22:19.937563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:22:19.937563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:22:19.937563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:22:19.937563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:22:19.937563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84087b72-4e56-413e-b975-c23f9f79d0d0 could not be found. Aug 19 21:22:19.937563 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:22:19.939076 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c519f7f0-10be-4a32-98a0-f0fd12cc33a7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Returning 404 to user: Instance 84087b72-4e56-413e-b975-c23f9f79d0d0 could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:22:19.939076 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-c519f7f0-10be-4a32-98a0-f0fd12cc33a7 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0" status: 404 len: 111 microversion: 2.1 time: 0.030205 Aug 19 21:22:19.939076 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 574/1072] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:22:19 2022] GET /compute/v2.1/servers/84087b72-4e56-413e-b975-c23f9f79d0d0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:22:20.099182 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-4958af3c-333b-4195-b8de-bf325d6f4e74 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] Calling method '.version_select at 0x7f740be2a670>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:22:20.125709 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-4958af3c-333b-4195-b8de-bf325d6f4e74 tempest-TestShelveInstance-663893316 tempest-TestShelveInstance-663893316-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-960460966" status: 202 len: 0 microversion: 2.1 time: 0.030321 Aug 19 21:22:20.126318 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 499/1073] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Aug 19 21:22:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-960460966 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:22:31.069458 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-772826fe-14bd-443d-a249-414e71f8a222 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:22:31.070017 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-772826fe-14bd-443d-a249-414e71f8a222 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 43c91efd-bd6f-4533-bc09-1dcd3d9d2591] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:22:31.073041 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=28 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:22:31.073721 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:22:31.079456 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-772826fe-14bd-443d-a249-414e71f8a222 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:31.079928 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-772826fe-14bd-443d-a249-414e71f8a222 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:31.080358 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-772826fe-14bd-443d-a249-414e71f8a222 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:31.081041 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-772826fe-14bd-443d-a249-414e71f8a222 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:31.081492 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-772826fe-14bd-443d-a249-414e71f8a222 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:31.081959 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-772826fe-14bd-443d-a249-414e71f8a222 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:31.167046 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.objects.instance [None req-772826fe-14bd-443d-a249-414e71f8a222 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lazy-loading 'services' on Instance uuid 43c91efd-bd6f-4533-bc09-1dcd3d9d2591 {{(pid=120877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:22:31.239142 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-772826fe-14bd-443d-a249-414e71f8a222 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "DELETE /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591/os-volume_attachments/7254b717-01d8-45d2-bf67-09bb1765b605" status: 202 len: 0 microversion: 2.1 time: 0.173576 Aug 19 21:22:31.239789 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 575/1074] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Aug 19 21:22:31 2022] DELETE /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591/os-volume_attachments/7254b717-01d8-45d2-bf67-09bb1765b605 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:22:32.362994 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:22:32.363744 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:22:32.367951 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-e70a814d-af2a-4425-86a5-5927632b35f3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:22:32.368433 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-e70a814d-af2a-4425-86a5-5927632b35f3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 43c91efd-bd6f-4533-bc09-1dcd3d9d2591] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:22:32.378007 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e70a814d-af2a-4425-86a5-5927632b35f3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:32.378486 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e70a814d-af2a-4425-86a5-5927632b35f3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:32.378949 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e70a814d-af2a-4425-86a5-5927632b35f3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:32.379626 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e70a814d-af2a-4425-86a5-5927632b35f3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:32.380073 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e70a814d-af2a-4425-86a5-5927632b35f3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:32.380484 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-e70a814d-af2a-4425-86a5-5927632b35f3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:32.411449 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-e70a814d-af2a-4425-86a5-5927632b35f3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 43c91efd-bd6f-4533-bc09-1dcd3d9d2591] Going to try to terminate instance {{(pid=120876) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 21:22:32.491347 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-e70a814d-af2a-4425-86a5-5927632b35f3 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "DELETE /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591" status: 204 len: 0 microversion: 2.1 time: 0.129629 Aug 19 21:22:32.492271 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 500/1075] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:22:32 2022] DELETE /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 21:22:32.501933 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8e9cd223-36ad-479d-ae83-621437f48d58 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:22:32.503230 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8e9cd223-36ad-479d-ae83-621437f48d58 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 43c91efd-bd6f-4533-bc09-1dcd3d9d2591] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:22:32.509364 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8e9cd223-36ad-479d-ae83-621437f48d58 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:32.509899 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8e9cd223-36ad-479d-ae83-621437f48d58 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:32.510403 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8e9cd223-36ad-479d-ae83-621437f48d58 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:32.511279 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8e9cd223-36ad-479d-ae83-621437f48d58 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:32.511789 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8e9cd223-36ad-479d-ae83-621437f48d58 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:32.512208 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8e9cd223-36ad-479d-ae83-621437f48d58 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:32.645707 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8e9cd223-36ad-479d-ae83-621437f48d58 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:22:32.653847 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8e9cd223-36ad-479d-ae83-621437f48d58 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591" status: 200 len: 1512 microversion: 2.1 time: 0.156597 Aug 19 21:22:32.654404 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 576/1076] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:22:32 2022] GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:22:33.675938 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-fab3e4df-378e-460f-925c-ef2de8d23a9b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:22:33.676768 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-fab3e4df-378e-460f-925c-ef2de8d23a9b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 43c91efd-bd6f-4533-bc09-1dcd3d9d2591] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:22:33.684138 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fab3e4df-378e-460f-925c-ef2de8d23a9b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:33.684642 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fab3e4df-378e-460f-925c-ef2de8d23a9b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:33.685066 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fab3e4df-378e-460f-925c-ef2de8d23a9b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:33.685749 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fab3e4df-378e-460f-925c-ef2de8d23a9b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:33.686229 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fab3e4df-378e-460f-925c-ef2de8d23a9b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:33.686643 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-fab3e4df-378e-460f-925c-ef2de8d23a9b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:33.820067 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-fab3e4df-378e-460f-925c-ef2de8d23a9b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:22:33.828486 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-fab3e4df-378e-460f-925c-ef2de8d23a9b tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591" status: 200 len: 1512 microversion: 2.1 time: 0.156834 Aug 19 21:22:33.829044 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 501/1077] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:22:33 2022] GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:22:34.771262 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-5df7adf3-9227-473f-b639-7979aeda6635 req-b39841fd-e60a-4368-b892-5a42aaff4b0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43c91efd-bd6f-4533-bc09-1dcd3d9d2591", "name": "network-vif-deleted", "tag": "5c45e7b5-6d1c-4bde-9486-534d19d20608"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:22:34.782053 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-5df7adf3-9227-473f-b639-7979aeda6635 req-b39841fd-e60a-4368-b892-5a42aaff4b0f service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:34.782527 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-5df7adf3-9227-473f-b639-7979aeda6635 req-b39841fd-e60a-4368-b892-5a42aaff4b0f service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:34.782949 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-5df7adf3-9227-473f-b639-7979aeda6635 req-b39841fd-e60a-4368-b892-5a42aaff4b0f service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:34.795176 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-5df7adf3-9227-473f-b639-7979aeda6635 req-b39841fd-e60a-4368-b892-5a42aaff4b0f service nova] Creating event network-vif-deleted:5c45e7b5-6d1c-4bde-9486-534d19d20608 for instance 43c91efd-bd6f-4533-bc09-1dcd3d9d2591 on hv-cinder-85220 Aug 19 21:22:34.800222 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-5df7adf3-9227-473f-b639-7979aeda6635 req-b39841fd-e60a-4368-b892-5a42aaff4b0f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032938 Aug 19 21:22:34.800808 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 577/1078] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:22:34.848594 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-26665bfe-8e1c-47f5-92a3-a135ac7083cd tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:22:34.849298 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-26665bfe-8e1c-47f5-92a3-a135ac7083cd tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 43c91efd-bd6f-4533-bc09-1dcd3d9d2591] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:22:34.856757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-26665bfe-8e1c-47f5-92a3-a135ac7083cd tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:34.857242 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-26665bfe-8e1c-47f5-92a3-a135ac7083cd tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:34.857883 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-26665bfe-8e1c-47f5-92a3-a135ac7083cd tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:34.858585 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-26665bfe-8e1c-47f5-92a3-a135ac7083cd tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:34.859030 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-26665bfe-8e1c-47f5-92a3-a135ac7083cd tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:34.859443 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-26665bfe-8e1c-47f5-92a3-a135ac7083cd tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:34.893429 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-26665bfe-8e1c-47f5-92a3-a135ac7083cd tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:34.893963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-26665bfe-8e1c-47f5-92a3-a135ac7083cd tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:34.894379 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-26665bfe-8e1c-47f5-92a3-a135ac7083cd tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:34.894824 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.objects.instance [None req-26665bfe-8e1c-47f5-92a3-a135ac7083cd tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lazy-loading 'fault' on Instance uuid 43c91efd-bd6f-4533-bc09-1dcd3d9d2591 {{(pid=120876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 21:22:34.940403 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-26665bfe-8e1c-47f5-92a3-a135ac7083cd tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96315b58c9e4ed38c97c0d3b50e8069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c290ef5d11bd457faab2536a334b9bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:22:34.948862 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-26665bfe-8e1c-47f5-92a3-a135ac7083cd tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591" status: 200 len: 1308 microversion: 2.1 time: 0.104147 Aug 19 21:22:34.949431 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 502/1079] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:22:34 2022] GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591 => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:22:35.970997 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0099a9c7-20db-48d0-9762-939e6b40fdb9 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:22:35.971810 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0099a9c7-20db-48d0-9762-939e6b40fdb9 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] [instance: 43c91efd-bd6f-4533-bc09-1dcd3d9d2591] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:22:35.978577 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0099a9c7-20db-48d0-9762-939e6b40fdb9 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:35.979243 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0099a9c7-20db-48d0-9762-939e6b40fdb9 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:35.979700 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0099a9c7-20db-48d0-9762-939e6b40fdb9 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:35.980439 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0099a9c7-20db-48d0-9762-939e6b40fdb9 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:22:35.980893 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0099a9c7-20db-48d0-9762-939e6b40fdb9 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:22:35.981311 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0099a9c7-20db-48d0-9762-939e6b40fdb9 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:22:35.997286 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-0099a9c7-20db-48d0-9762-939e6b40fdb9 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] HTTP exception thrown: Instance 43c91efd-bd6f-4533-bc09-1dcd3d9d2591 could not be found. Aug 19 21:22:35.998939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0099a9c7-20db-48d0-9762-939e6b40fdb9 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Request method failure captured: Aug 19 21:22:35.998939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591 HTTP/1.1 Aug 19 21:22:35.998939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:22:35.998939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:22:35.998939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:22:35.998939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:22:35.998939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:22:35.998939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:22:35.998939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:22:35.998939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:22:35.998939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__6lU47myxVnxxo7sgtH_wLtmcEtFZMJalluELaF2glbRZ1ItQVaOclFZAZx-B8LOVHmpP_c0S4GVABW51d-XMRjEVVVdbPkR8ldZNOlF0dxdBJdez8SYGel9KiBpboAv8TWO7N4Ime-A4c2SZoBuCaCbgqPXOrHoEMRR9rdQ3e3TaA Aug 19 21:22:35.998939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:22:35.998939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:22:35.998939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:22:35.998939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:22:35.998939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:22:35.998939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:22:35.998939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: c290ef5d11bd457faab2536a334b9bb7 Aug 19 21:22:35.998939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-VolumesSnapshotTestJSON-503779764 Aug 19 21:22:35.998939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:22:35.998939 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:22:36.000684 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c290ef5d11bd457faab2536a334b9bb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c290ef5d11bd457faab2536a334b9bb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c290ef5d11bd457faab2536a334b9bb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c290ef5d11bd457faab2536a334b9bb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:22:36.000684 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-VolumesSnapshotTestJSON-503779764 Aug 19 21:22:36.000684 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: c290ef5d11bd457faab2536a334b9bb7 Aug 19 21:22:36.000684 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-503779764 Aug 19 21:22:36.000684 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-VolumesSnapshotTestJSON-503779764-project Aug 19 21:22:36.000684 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:22:36.000684 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:22:36.000684 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: d96315b58c9e4ed38c97c0d3b50e8069 Aug 19 21:22:36.000684 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-VolumesSnapshotTestJSON-503779764-project Aug 19 21:22:36.000684 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: > Aug 19 21:22:36.000684 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Instance 43c91efd-bd6f-4533-bc09-1dcd3d9d2591 could not be found. Aug 19 21:22:36.000684 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'id': '43c91efd-bd6f-4533-bc09-1dcd3d9d2591'} Aug 19 21:22:36.001955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:22:36.001955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:22:36.001955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:22:36.001955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:22:36.001955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:22:36.001955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:22:36.001955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:22:36.001955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:22:36.001955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:22:36.001955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:22:36.001955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43c91efd-bd6f-4533-bc09-1dcd3d9d2591 could not be found. Aug 19 21:22:36.001955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:22:36.001955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:22:36.001955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:22:36.001955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:22:36.001955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:22:36.001955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:22:36.001955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:22:36.001955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:22:36.001955 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:22:36.003598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:22:36.003598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:22:36.003598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:22:36.003598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:22:36.003598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:22:36.003598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:22:36.003598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:22:36.003598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43c91efd-bd6f-4533-bc09-1dcd3d9d2591 could not be found. Aug 19 21:22:36.003598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:22:36.003598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:22:36.003598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:22:36.003598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:22:36.003598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:22:36.003598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:22:36.003598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:22:36.003598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:22:36.003598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43c91efd-bd6f-4533-bc09-1dcd3d9d2591 could not be found. Aug 19 21:22:36.003598 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:22:36.005126 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0099a9c7-20db-48d0-9762-939e6b40fdb9 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] Returning 404 to user: Instance 43c91efd-bd6f-4533-bc09-1dcd3d9d2591 could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:22:36.005126 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0099a9c7-20db-48d0-9762-939e6b40fdb9 tempest-VolumesSnapshotTestJSON-503779764 tempest-VolumesSnapshotTestJSON-503779764-project] 10.222.0.16 "GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591" status: 404 len: 111 microversion: 2.1 time: 0.034512 Aug 19 21:22:36.005126 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 578/1080] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:22:35 2022] GET /compute/v2.1/servers/43c91efd-bd6f-4533-bc09-1dcd3d9d2591 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:23:17.581164 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-7c4ee0ca-4156-4954-a470-802b55e5f111 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:17.581779 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-7c4ee0ca-4156-4954-a470-802b55e5f111 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:17.583772 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:23:17.584620 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:23:17.591029 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7c4ee0ca-4156-4954-a470-802b55e5f111 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:17.591518 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7c4ee0ca-4156-4954-a470-802b55e5f111 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:17.591984 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7c4ee0ca-4156-4954-a470-802b55e5f111 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:17.592680 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7c4ee0ca-4156-4954-a470-802b55e5f111 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:17.593133 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7c4ee0ca-4156-4954-a470-802b55e5f111 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:17.593558 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7c4ee0ca-4156-4954-a470-802b55e5f111 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:17.619214 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-7c4ee0ca-4156-4954-a470-802b55e5f111 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Going to try to terminate instance {{(pid=120876) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 21:23:17.698014 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-7c4ee0ca-4156-4954-a470-802b55e5f111 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "DELETE /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 204 len: 0 microversion: 2.1 time: 0.120265 Aug 19 21:23:17.699921 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 503/1081] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:23:17 2022] DELETE /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 21:23:17.708560 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8d86441f-ec02-4fca-9e5d-5a2f84afe8cd tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:17.709170 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8d86441f-ec02-4fca-9e5d-5a2f84afe8cd tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:17.711526 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=8 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:23:17.712163 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:23:17.717681 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8d86441f-ec02-4fca-9e5d-5a2f84afe8cd tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:17.718229 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8d86441f-ec02-4fca-9e5d-5a2f84afe8cd tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:17.718668 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8d86441f-ec02-4fca-9e5d-5a2f84afe8cd tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:17.719358 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8d86441f-ec02-4fca-9e5d-5a2f84afe8cd tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:17.719815 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8d86441f-ec02-4fca-9e5d-5a2f84afe8cd tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:17.720243 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8d86441f-ec02-4fca-9e5d-5a2f84afe8cd tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:18.062380 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-8d86441f-ec02-4fca-9e5d-5a2f84afe8cd tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:23:18.070126 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8d86441f-ec02-4fca-9e5d-5a2f84afe8cd tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 200 len: 1578 microversion: 2.1 time: 0.365404 Aug 19 21:23:18.070686 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 579/1082] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:23:17 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 1578 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:23:19.093047 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-8b2c68d4-a041-4508-9caf-518d6fdfcd55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:19.093750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-8b2c68d4-a041-4508-9caf-518d6fdfcd55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:19.100284 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8b2c68d4-a041-4508-9caf-518d6fdfcd55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:19.100762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8b2c68d4-a041-4508-9caf-518d6fdfcd55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:19.101193 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8b2c68d4-a041-4508-9caf-518d6fdfcd55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:19.101903 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8b2c68d4-a041-4508-9caf-518d6fdfcd55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:19.102360 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8b2c68d4-a041-4508-9caf-518d6fdfcd55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:19.102779 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-8b2c68d4-a041-4508-9caf-518d6fdfcd55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:19.291869 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-8b2c68d4-a041-4508-9caf-518d6fdfcd55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:23:19.300108 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-8b2c68d4-a041-4508-9caf-518d6fdfcd55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 200 len: 1578 microversion: 2.1 time: 0.211967 Aug 19 21:23:19.300670 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 504/1083] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:23:19 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 1578 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:23:20.181635 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-70cc6838-655b-4d5f-95e2-87d40021df62 req-8d6c036e-76ff-4895-97ac-b09175446de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67d0593a-5bf1-4f0d-94ac-89589766e987", "name": "network-vif-deleted", "tag": "6d5e449a-8209-480b-a248-e22d0f1c6658"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:23:20.192020 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-70cc6838-655b-4d5f-95e2-87d40021df62 req-8d6c036e-76ff-4895-97ac-b09175446de7 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:20.192577 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-70cc6838-655b-4d5f-95e2-87d40021df62 req-8d6c036e-76ff-4895-97ac-b09175446de7 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:20.192989 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-70cc6838-655b-4d5f-95e2-87d40021df62 req-8d6c036e-76ff-4895-97ac-b09175446de7 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:20.206734 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-70cc6838-655b-4d5f-95e2-87d40021df62 req-8d6c036e-76ff-4895-97ac-b09175446de7 service nova] Creating event network-vif-deleted:6d5e449a-8209-480b-a248-e22d0f1c6658 for instance 67d0593a-5bf1-4f0d-94ac-89589766e987 on hv-cinder-85220 Aug 19 21:23:20.215069 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-70cc6838-655b-4d5f-95e2-87d40021df62 req-8d6c036e-76ff-4895-97ac-b09175446de7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036396 Aug 19 21:23:20.215672 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 580/1084] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:23:20.320826 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-b3564a45-ac72-4456-8e08-1cb7c8572356 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:20.321443 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-b3564a45-ac72-4456-8e08-1cb7c8572356 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:20.329911 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3564a45-ac72-4456-8e08-1cb7c8572356 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:20.330495 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3564a45-ac72-4456-8e08-1cb7c8572356 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:20.331182 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3564a45-ac72-4456-8e08-1cb7c8572356 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:20.331970 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3564a45-ac72-4456-8e08-1cb7c8572356 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:20.332498 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3564a45-ac72-4456-8e08-1cb7c8572356 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:20.333005 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-b3564a45-ac72-4456-8e08-1cb7c8572356 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:20.410786 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-b3564a45-ac72-4456-8e08-1cb7c8572356 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:23:20.426530 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-b3564a45-ac72-4456-8e08-1cb7c8572356 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 200 len: 1226 microversion: 2.1 time: 0.109605 Aug 19 21:23:20.427129 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 505/1085] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:23:20 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 1226 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:23:21.453086 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-05bda447-5379-43c2-854c-affac27e0b55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:21.453696 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-05bda447-5379-43c2-854c-affac27e0b55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:21.460322 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-05bda447-5379-43c2-854c-affac27e0b55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:21.460860 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-05bda447-5379-43c2-854c-affac27e0b55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:21.461284 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-05bda447-5379-43c2-854c-affac27e0b55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:21.462020 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-05bda447-5379-43c2-854c-affac27e0b55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:21.462543 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-05bda447-5379-43c2-854c-affac27e0b55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:21.463239 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-05bda447-5379-43c2-854c-affac27e0b55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:21.478137 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-05bda447-5379-43c2-854c-affac27e0b55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] HTTP exception thrown: Instance 67d0593a-5bf1-4f0d-94ac-89589766e987 could not be found. Aug 19 21:23:21.480457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-05bda447-5379-43c2-854c-affac27e0b55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Request method failure captured: Aug 19 21:23:21.480457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 HTTP/1.1 Aug 19 21:23:21.480457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:23:21.480457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:23:21.480457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:23:21.480457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:23:21.480457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:23:21.480457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:23:21.480457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:23:21.480457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:23:21.480457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__5dJQ5Gcc7zHJnocFNrsoN6EnfMLReP5j1JpR1-_XK_2pQn5X2lqyTE8_DC917GQxE0DynYvBfXWw6hPfOmPGsZ9Job0Xos-VAbUnoy6UmBzAIF5HQ7QpROl1L8qKnaqTnE4vu89WHk3eVPqKw5KFO4L0U5lzhdWZ5ACJQ394XTCYQ Aug 19 21:23:21.480457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:23:21.480457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:23:21.480457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:23:21.480457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:23:21.480457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:23:21.480457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:23:21.480457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: b5c70daaa3b340a286f8f4ebe26b807d Aug 19 21:23:21.480457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-TestVolumeBootPattern-891379969 Aug 19 21:23:21.480457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:23:21.480457 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:23:21.482328 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b5c70daaa3b340a286f8f4ebe26b807d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b5c70daaa3b340a286f8f4ebe26b807d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b5c70daaa3b340a286f8f4ebe26b807d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b5c70daaa3b340a286f8f4ebe26b807d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:23:21.482328 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-TestVolumeBootPattern-891379969 Aug 19 21:23:21.482328 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: b5c70daaa3b340a286f8f4ebe26b807d Aug 19 21:23:21.482328 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-TestVolumeBootPattern-891379969 Aug 19 21:23:21.482328 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-TestVolumeBootPattern-891379969-project Aug 19 21:23:21.482328 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:23:21.482328 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:23:21.482328 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: d2749b3c8da94ce1b4af6c708a2f9db6 Aug 19 21:23:21.482328 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-TestVolumeBootPattern-891379969-project Aug 19 21:23:21.482328 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: > Aug 19 21:23:21.482328 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Instance 67d0593a-5bf1-4f0d-94ac-89589766e987 could not be found. Aug 19 21:23:21.482328 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'id': '67d0593a-5bf1-4f0d-94ac-89589766e987'} Aug 19 21:23:21.483234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:23:21.483234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:23:21.483234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:23:21.483234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:23:21.483234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:23:21.483234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:23:21.483234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:23:21.483234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:23:21.483234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:23:21.483234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:23:21.483234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67d0593a-5bf1-4f0d-94ac-89589766e987 could not be found. Aug 19 21:23:21.483234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:23:21.483234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:23:21.483234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:23:21.483234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:23:21.483234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:23:21.483234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:23:21.483234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:23:21.483234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:23:21.483234 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:23:21.485176 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:23:21.485176 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:23:21.485176 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:23:21.485176 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:23:21.485176 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:23:21.485176 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:23:21.485176 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:23:21.485176 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67d0593a-5bf1-4f0d-94ac-89589766e987 could not be found. Aug 19 21:23:21.485176 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:23:21.485176 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:23:21.485176 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:23:21.485176 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:23:21.485176 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:23:21.485176 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:23:21.485176 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:23:21.485176 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:23:21.485176 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67d0593a-5bf1-4f0d-94ac-89589766e987 could not be found. Aug 19 21:23:21.485176 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:23:21.486792 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-05bda447-5379-43c2-854c-affac27e0b55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Returning 404 to user: Instance 67d0593a-5bf1-4f0d-94ac-89589766e987 could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:23:21.486792 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-05bda447-5379-43c2-854c-affac27e0b55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 404 len: 111 microversion: 2.1 time: 0.034531 Aug 19 21:23:21.486792 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 581/1086] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:23:21 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:23:21.581264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-1ac92f6a-e3ad-49ce-bb2e-4356640071db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-928909534", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1136394165", "security_groups": [{"name": "tempest-secgroup-smoke-1474901084"}], "block_device_mapping_v2": [{"uuid": "a3d9f46d-5c06-426a-a2f4-94fda6095b52", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "467ee159-81ce-42fd-8258-d5228258cf1c"}]}} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:23:21.722570 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.network.neutron [None req-1ac92f6a-e3ad-49ce-bb2e-4356640071db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] validate_networks() for [('467ee159-81ce-42fd-8258-d5228258cf1c', None, None, None, None, None)] {{(pid=120876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 21:23:22.165934 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-1ac92f6a-e3ad-49ce-bb2e-4356640071db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Flavor limits 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 21:23:22.167016 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-1ac92f6a-e3ad-49ce-bb2e-4356640071db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Image limits 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 21:23:22.168767 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-1ac92f6a-e3ad-49ce-bb2e-4356640071db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Flavor pref 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 21:23:22.169431 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-1ac92f6a-e3ad-49ce-bb2e-4356640071db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Image pref 0:0:0 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 21:23:22.170240 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.virt.hardware [None req-1ac92f6a-e3ad-49ce-bb2e-4356640071db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 21:23:22.180749 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1ac92f6a-e3ad-49ce-bb2e-4356640071db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:22.181142 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1ac92f6a-e3ad-49ce-bb2e-4356640071db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:22.181571 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1ac92f6a-e3ad-49ce-bb2e-4356640071db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:22.182329 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1ac92f6a-e3ad-49ce-bb2e-4356640071db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:22.183551 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1ac92f6a-e3ad-49ce-bb2e-4356640071db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:22.184473 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-1ac92f6a-e3ad-49ce-bb2e-4356640071db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:22.207972 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-1ac92f6a-e3ad-49ce-bb2e-4356640071db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Getting quotas for project b5c70daaa3b340a286f8f4ebe26b807d. Resources: {'cores', 'ram', 'instances'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:23:22.212227 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.quota [None req-1ac92f6a-e3ad-49ce-bb2e-4356640071db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Getting quotas for user d2749b3c8da94ce1b4af6c708a2f9db6 and project b5c70daaa3b340a286f8f4ebe26b807d. Resources: {'cores', 'ram', 'instances'} {{(pid=120876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:23:22.281059 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-1ac92f6a-e3ad-49ce-bb2e-4356640071db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Going to run 1 instances... {{(pid=120876) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 21:23:22.283430 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-1ac92f6a-e3ad-49ce-bb2e-4356640071db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a3d9f46d-5c06-426a-a2f4-94fda6095b52',volume_size=None,volume_type=None)] {{(pid=120876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 21:23:22.430762 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-1ac92f6a-e3ad-49ce-bb2e-4356640071db tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.853356 Aug 19 21:23:22.431407 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 506/1087] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Aug 19 21:23:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 21:23:22.442920 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c765667c-9f28-43d3-8bca-681610c9ba3f tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:22.443525 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-c765667c-9f28-43d3-8bca-681610c9ba3f tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:22.503116 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-c765667c-9f28-43d3-8bca-681610c9ba3f tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:23:22.510167 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-c765667c-9f28-43d3-8bca-681610c9ba3f tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 200 len: 1094 microversion: 2.1 time: 0.071110 Aug 19 21:23:22.510765 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 582/1088] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:23:22 2022] GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:23:23.532078 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-eb48cf73-0343-4be4-a912-0d4f5484da77 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:23.532548 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-eb48cf73-0343-4be4-a912-0d4f5484da77 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:23.585296 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-eb48cf73-0343-4be4-a912-0d4f5484da77 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:23:23.593163 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-eb48cf73-0343-4be4-a912-0d4f5484da77 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 200 len: 1094 microversion: 2.1 time: 0.065500 Aug 19 21:23:23.593716 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 507/1089] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:23:23 2022] GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:23:24.616126 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-6efbd1ca-4f8d-46cf-8b07-865f3fa69e9b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:24.616748 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-6efbd1ca-4f8d-46cf-8b07-865f3fa69e9b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:24.677246 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-6efbd1ca-4f8d-46cf-8b07-865f3fa69e9b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:23:24.685865 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-6efbd1ca-4f8d-46cf-8b07-865f3fa69e9b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 200 len: 1094 microversion: 2.1 time: 0.073714 Aug 19 21:23:24.686603 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 583/1090] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:23:24 2022] GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:23:25.707453 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-50c01be5-7110-4936-a4fb-91d7755ade55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:25.708057 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-50c01be5-7110-4936-a4fb-91d7755ade55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:25.767651 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-50c01be5-7110-4936-a4fb-91d7755ade55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:23:25.775133 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-50c01be5-7110-4936-a4fb-91d7755ade55 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 200 len: 1094 microversion: 2.1 time: 0.071727 Aug 19 21:23:25.775427 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 508/1091] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:23:25 2022] GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:23:26.795436 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e302c034-78fd-4439-906a-e8f1d84b4727 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:26.796047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-e302c034-78fd-4439-906a-e8f1d84b4727 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:26.802453 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e302c034-78fd-4439-906a-e8f1d84b4727 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:26.802943 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e302c034-78fd-4439-906a-e8f1d84b4727 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:26.803381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e302c034-78fd-4439-906a-e8f1d84b4727 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:26.804074 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e302c034-78fd-4439-906a-e8f1d84b4727 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:26.804528 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e302c034-78fd-4439-906a-e8f1d84b4727 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:26.804989 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e302c034-78fd-4439-906a-e8f1d84b4727 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:26.868655 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e302c034-78fd-4439-906a-e8f1d84b4727 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:23:26.876520 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e302c034-78fd-4439-906a-e8f1d84b4727 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 200 len: 1144 microversion: 2.1 time: 0.085134 Aug 19 21:23:26.877085 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 584/1092] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:23:26 2022] GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:23:27.193395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 21:23:27.193651 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Fri Aug 19 21:23:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 21:23:27.898651 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-942fcb20-59de-4f3c-a819-df76b2e39d50 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:27.899890 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-942fcb20-59de-4f3c-a819-df76b2e39d50 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:27.908218 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-942fcb20-59de-4f3c-a819-df76b2e39d50 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:27.908721 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-942fcb20-59de-4f3c-a819-df76b2e39d50 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:27.909153 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-942fcb20-59de-4f3c-a819-df76b2e39d50 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:27.909907 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-942fcb20-59de-4f3c-a819-df76b2e39d50 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:27.910362 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-942fcb20-59de-4f3c-a819-df76b2e39d50 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:27.911064 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-942fcb20-59de-4f3c-a819-df76b2e39d50 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:27.991008 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-942fcb20-59de-4f3c-a819-df76b2e39d50 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:23:27.999076 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-942fcb20-59de-4f3c-a819-df76b2e39d50 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 200 len: 1210 microversion: 2.1 time: 0.104627 Aug 19 21:23:27.999640 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 509/1093] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:23:27 2022] GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 1210 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:23:28.722631 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-9312bc43-f17e-4b3e-a451-86fa770bdf4e req-e7a31f3e-f977-4fbf-9d94-80034e5c38d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a9b9c91-f09b-4454-b794-8f5da4a7046b", "tag": "69096231-9831-4016-a83c-1e4087e432ca"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:23:28.733587 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-9312bc43-f17e-4b3e-a451-86fa770bdf4e req-e7a31f3e-f977-4fbf-9d94-80034e5c38d8 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:28.733587 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-9312bc43-f17e-4b3e-a451-86fa770bdf4e req-e7a31f3e-f977-4fbf-9d94-80034e5c38d8 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:28.734135 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-9312bc43-f17e-4b3e-a451-86fa770bdf4e req-e7a31f3e-f977-4fbf-9d94-80034e5c38d8 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:28.746050 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-9312bc43-f17e-4b3e-a451-86fa770bdf4e req-e7a31f3e-f977-4fbf-9d94-80034e5c38d8 service nova] Creating event network-changed:69096231-9831-4016-a83c-1e4087e432ca for instance 1a9b9c91-f09b-4454-b794-8f5da4a7046b on hv-cinder-85220 Aug 19 21:23:28.751138 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-9312bc43-f17e-4b3e-a451-86fa770bdf4e req-e7a31f3e-f977-4fbf-9d94-80034e5c38d8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032385 Aug 19 21:23:28.751746 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 585/1094] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:23:29.020497 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-7202dcce-6fc0-4eb4-aedf-844f9acf6fb5 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:29.021258 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-7202dcce-6fc0-4eb4-aedf-844f9acf6fb5 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:29.029996 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7202dcce-6fc0-4eb4-aedf-844f9acf6fb5 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:29.032090 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7202dcce-6fc0-4eb4-aedf-844f9acf6fb5 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:29.032538 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7202dcce-6fc0-4eb4-aedf-844f9acf6fb5 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:29.034407 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7202dcce-6fc0-4eb4-aedf-844f9acf6fb5 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:29.034865 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7202dcce-6fc0-4eb4-aedf-844f9acf6fb5 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:29.035289 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7202dcce-6fc0-4eb4-aedf-844f9acf6fb5 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:29.480690 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-7202dcce-6fc0-4eb4-aedf-844f9acf6fb5 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:23:29.488484 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-7202dcce-6fc0-4eb4-aedf-844f9acf6fb5 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 200 len: 1266 microversion: 2.1 time: 0.471884 Aug 19 21:23:29.489039 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 510/1095] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:23:29 2022] GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 1266 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:23:30.510897 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-f1f99fbb-61ce-40df-8dc2-4c12ef25d0ad tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:30.511695 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-f1f99fbb-61ce-40df-8dc2-4c12ef25d0ad tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:30.517907 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f1f99fbb-61ce-40df-8dc2-4c12ef25d0ad tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:30.518394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f1f99fbb-61ce-40df-8dc2-4c12ef25d0ad tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:30.518824 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f1f99fbb-61ce-40df-8dc2-4c12ef25d0ad tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:30.519511 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f1f99fbb-61ce-40df-8dc2-4c12ef25d0ad tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:30.519963 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f1f99fbb-61ce-40df-8dc2-4c12ef25d0ad tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:30.520383 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-f1f99fbb-61ce-40df-8dc2-4c12ef25d0ad tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:30.709926 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-f1f99fbb-61ce-40df-8dc2-4c12ef25d0ad tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:23:30.718135 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-f1f99fbb-61ce-40df-8dc2-4c12ef25d0ad tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 200 len: 1266 microversion: 2.1 time: 0.211939 Aug 19 21:23:30.718708 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 586/1096] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:23:30 2022] GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:23:31.739317 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-209a588e-338b-4d0e-9d47-9f89eca139a1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:31.739959 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-209a588e-338b-4d0e-9d47-9f89eca139a1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:31.746921 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-209a588e-338b-4d0e-9d47-9f89eca139a1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:31.747409 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-209a588e-338b-4d0e-9d47-9f89eca139a1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:31.747844 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-209a588e-338b-4d0e-9d47-9f89eca139a1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:31.748537 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-209a588e-338b-4d0e-9d47-9f89eca139a1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:31.748990 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-209a588e-338b-4d0e-9d47-9f89eca139a1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:31.749413 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-209a588e-338b-4d0e-9d47-9f89eca139a1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:31.883551 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-209a588e-338b-4d0e-9d47-9f89eca139a1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:23:31.892250 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-209a588e-338b-4d0e-9d47-9f89eca139a1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 200 len: 1266 microversion: 2.1 time: 0.156803 Aug 19 21:23:31.892810 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 511/1097] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:23:31 2022] GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:23:32.913990 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-dcd947bb-47fb-4f54-966d-8ed111b3d81b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:32.914586 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-dcd947bb-47fb-4f54-966d-8ed111b3d81b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:32.921558 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dcd947bb-47fb-4f54-966d-8ed111b3d81b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:32.922063 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dcd947bb-47fb-4f54-966d-8ed111b3d81b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:32.922492 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dcd947bb-47fb-4f54-966d-8ed111b3d81b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:32.923173 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dcd947bb-47fb-4f54-966d-8ed111b3d81b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:32.923621 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dcd947bb-47fb-4f54-966d-8ed111b3d81b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:32.924038 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-dcd947bb-47fb-4f54-966d-8ed111b3d81b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:33.055045 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-dcd947bb-47fb-4f54-966d-8ed111b3d81b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:23:33.063471 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-dcd947bb-47fb-4f54-966d-8ed111b3d81b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 200 len: 1266 microversion: 2.1 time: 0.153422 Aug 19 21:23:33.064034 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 587/1098] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:23:32 2022] GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:23:34.083592 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-62038acb-8adb-4be8-ae30-2d0af1622d92 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:34.084200 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-62038acb-8adb-4be8-ae30-2d0af1622d92 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:34.086056 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=2 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:23:34.093598 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-62038acb-8adb-4be8-ae30-2d0af1622d92 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:34.094108 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-62038acb-8adb-4be8-ae30-2d0af1622d92 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:34.094537 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-62038acb-8adb-4be8-ae30-2d0af1622d92 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:34.095226 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-62038acb-8adb-4be8-ae30-2d0af1622d92 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:34.095678 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-62038acb-8adb-4be8-ae30-2d0af1622d92 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:34.096094 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-62038acb-8adb-4be8-ae30-2d0af1622d92 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:34.232539 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-62038acb-8adb-4be8-ae30-2d0af1622d92 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:23:34.240407 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-62038acb-8adb-4be8-ae30-2d0af1622d92 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 200 len: 1266 microversion: 2.1 time: 0.160863 Aug 19 21:23:34.241029 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 512/1099] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:23:34 2022] GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:23:35.260536 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-493ae45b-b7f5-4750-bce9-d457a99f1c23 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:35.261144 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-493ae45b-b7f5-4750-bce9-d457a99f1c23 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:35.264236 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=4 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:23:35.269546 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-493ae45b-b7f5-4750-bce9-d457a99f1c23 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:35.270068 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-493ae45b-b7f5-4750-bce9-d457a99f1c23 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:35.270504 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-493ae45b-b7f5-4750-bce9-d457a99f1c23 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:35.271198 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-493ae45b-b7f5-4750-bce9-d457a99f1c23 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:35.271920 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-493ae45b-b7f5-4750-bce9-d457a99f1c23 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:35.272343 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-493ae45b-b7f5-4750-bce9-d457a99f1c23 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:35.405753 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-493ae45b-b7f5-4750-bce9-d457a99f1c23 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:23:35.413481 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-493ae45b-b7f5-4750-bce9-d457a99f1c23 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 200 len: 1266 microversion: 2.1 time: 0.156799 Aug 19 21:23:35.414082 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 588/1100] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:23:35 2022] GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:23:36.434292 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-42530134-a0d2-4285-90b2-f732ba518850 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:36.435485 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-42530134-a0d2-4285-90b2-f732ba518850 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:36.438060 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=10 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:23:36.443827 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-42530134-a0d2-4285-90b2-f732ba518850 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:36.444311 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-42530134-a0d2-4285-90b2-f732ba518850 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:36.444742 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-42530134-a0d2-4285-90b2-f732ba518850 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:36.445430 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-42530134-a0d2-4285-90b2-f732ba518850 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:36.445913 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-42530134-a0d2-4285-90b2-f732ba518850 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:36.446351 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-42530134-a0d2-4285-90b2-f732ba518850 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:36.585579 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-42530134-a0d2-4285-90b2-f732ba518850 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:23:36.593930 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-42530134-a0d2-4285-90b2-f732ba518850 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 200 len: 1266 microversion: 2.1 time: 0.163568 Aug 19 21:23:36.594489 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 513/1101] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:23:36 2022] GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:23:37.615612 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-efb5c1f6-d5f7-45a7-80bb-8e4fef9b3ae4 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:37.616202 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-efb5c1f6-d5f7-45a7-80bb-8e4fef9b3ae4 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:37.623216 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-efb5c1f6-d5f7-45a7-80bb-8e4fef9b3ae4 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:37.623697 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-efb5c1f6-d5f7-45a7-80bb-8e4fef9b3ae4 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:37.624130 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-efb5c1f6-d5f7-45a7-80bb-8e4fef9b3ae4 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:37.624827 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-efb5c1f6-d5f7-45a7-80bb-8e4fef9b3ae4 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:37.625296 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-efb5c1f6-d5f7-45a7-80bb-8e4fef9b3ae4 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:37.625708 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-efb5c1f6-d5f7-45a7-80bb-8e4fef9b3ae4 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:37.762335 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-efb5c1f6-d5f7-45a7-80bb-8e4fef9b3ae4 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:23:37.770944 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-efb5c1f6-d5f7-45a7-80bb-8e4fef9b3ae4 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 200 len: 1266 microversion: 2.1 time: 0.159370 Aug 19 21:23:37.771507 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 589/1102] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:23:37 2022] GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:23:38.791968 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d4027771-e536-42c0-a52c-a0b2772cf6d0 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:38.792569 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-d4027771-e536-42c0-a52c-a0b2772cf6d0 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:38.799613 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d4027771-e536-42c0-a52c-a0b2772cf6d0 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:38.800092 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d4027771-e536-42c0-a52c-a0b2772cf6d0 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:38.800522 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d4027771-e536-42c0-a52c-a0b2772cf6d0 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:38.801206 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d4027771-e536-42c0-a52c-a0b2772cf6d0 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:38.801656 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d4027771-e536-42c0-a52c-a0b2772cf6d0 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:38.802113 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d4027771-e536-42c0-a52c-a0b2772cf6d0 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:38.935475 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-d4027771-e536-42c0-a52c-a0b2772cf6d0 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:23:38.943188 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-d4027771-e536-42c0-a52c-a0b2772cf6d0 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 200 len: 1266 microversion: 2.1 time: 0.155066 Aug 19 21:23:38.943745 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 514/1103] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:23:38 2022] GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:23:39.964500 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a76a12b1-aea3-4830-8c50-9a6a44b19159 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:39.965087 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-a76a12b1-aea3-4830-8c50-9a6a44b19159 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:39.972157 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a76a12b1-aea3-4830-8c50-9a6a44b19159 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:39.972636 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a76a12b1-aea3-4830-8c50-9a6a44b19159 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:39.973067 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a76a12b1-aea3-4830-8c50-9a6a44b19159 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:39.973747 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a76a12b1-aea3-4830-8c50-9a6a44b19159 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:39.974223 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a76a12b1-aea3-4830-8c50-9a6a44b19159 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:39.974639 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a76a12b1-aea3-4830-8c50-9a6a44b19159 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:40.113376 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-a76a12b1-aea3-4830-8c50-9a6a44b19159 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:23:40.121063 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-a76a12b1-aea3-4830-8c50-9a6a44b19159 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 200 len: 1266 microversion: 2.1 time: 0.160506 Aug 19 21:23:40.121616 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 590/1104] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:23:39 2022] GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:23:41.142128 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-f4f573f4-5642-4132-bbc3-4f60a73d0f25 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:41.142871 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-f4f573f4-5642-4132-bbc3-4f60a73d0f25 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:41.149557 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f4f573f4-5642-4132-bbc3-4f60a73d0f25 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:41.150071 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f4f573f4-5642-4132-bbc3-4f60a73d0f25 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:41.150628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f4f573f4-5642-4132-bbc3-4f60a73d0f25 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:41.151193 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f4f573f4-5642-4132-bbc3-4f60a73d0f25 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:41.151648 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f4f573f4-5642-4132-bbc3-4f60a73d0f25 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:41.152074 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-f4f573f4-5642-4132-bbc3-4f60a73d0f25 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:41.190861 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-ca3084e8-29c5-43f1-894e-5a17e57acb98 req-5827fdee-651f-42e4-8167-5fe3b579692a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a9b9c91-f09b-4454-b794-8f5da4a7046b", "name": "network-vif-plugged", "status": "completed", "tag": "69096231-9831-4016-a83c-1e4087e432ca"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:23:41.205381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-ca3084e8-29c5-43f1-894e-5a17e57acb98 req-5827fdee-651f-42e4-8167-5fe3b579692a service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:41.206182 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-ca3084e8-29c5-43f1-894e-5a17e57acb98 req-5827fdee-651f-42e4-8167-5fe3b579692a service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:41.206799 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-ca3084e8-29c5-43f1-894e-5a17e57acb98 req-5827fdee-651f-42e4-8167-5fe3b579692a service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:41.219031 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-ca3084e8-29c5-43f1-894e-5a17e57acb98 req-5827fdee-651f-42e4-8167-5fe3b579692a service nova] Creating event network-vif-plugged:69096231-9831-4016-a83c-1e4087e432ca for instance 1a9b9c91-f09b-4454-b794-8f5da4a7046b on hv-cinder-85220 Aug 19 21:23:41.225488 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-ca3084e8-29c5-43f1-894e-5a17e57acb98 req-5827fdee-651f-42e4-8167-5fe3b579692a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040160 Aug 19 21:23:41.226290 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 591/1105] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:23:41.296440 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-f4f573f4-5642-4132-bbc3-4f60a73d0f25 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:23:41.304269 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-f4f573f4-5642-4132-bbc3-4f60a73d0f25 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 200 len: 1266 microversion: 2.1 time: 0.166129 Aug 19 21:23:41.304831 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 515/1106] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:23:41 2022] GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:23:42.328451 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-7702d111-a7e8-495d-b14f-15e893e48f62 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:42.329150 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-7702d111-a7e8-495d-b14f-15e893e48f62 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:42.335619 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7702d111-a7e8-495d-b14f-15e893e48f62 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:42.336109 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7702d111-a7e8-495d-b14f-15e893e48f62 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:42.336550 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7702d111-a7e8-495d-b14f-15e893e48f62 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:42.337247 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7702d111-a7e8-495d-b14f-15e893e48f62 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:42.337706 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7702d111-a7e8-495d-b14f-15e893e48f62 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:42.338660 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7702d111-a7e8-495d-b14f-15e893e48f62 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:42.469615 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-7702d111-a7e8-495d-b14f-15e893e48f62 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:23:42.477433 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-7702d111-a7e8-495d-b14f-15e893e48f62 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 200 len: 1266 microversion: 2.1 time: 0.154579 Aug 19 21:23:42.478030 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 592/1107] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:23:42 2022] GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:23:43.498638 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-cbb5307b-32c7-4bdb-b6e8-41b0a7c0abe7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:43.499201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-cbb5307b-32c7-4bdb-b6e8-41b0a7c0abe7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:43.505581 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cbb5307b-32c7-4bdb-b6e8-41b0a7c0abe7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:43.506102 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cbb5307b-32c7-4bdb-b6e8-41b0a7c0abe7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:43.506536 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cbb5307b-32c7-4bdb-b6e8-41b0a7c0abe7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:43.507232 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cbb5307b-32c7-4bdb-b6e8-41b0a7c0abe7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:43.507682 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cbb5307b-32c7-4bdb-b6e8-41b0a7c0abe7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:43.508106 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cbb5307b-32c7-4bdb-b6e8-41b0a7c0abe7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:43.643955 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-cbb5307b-32c7-4bdb-b6e8-41b0a7c0abe7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:23:43.652011 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-cbb5307b-32c7-4bdb-b6e8-41b0a7c0abe7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 200 len: 1453 microversion: 2.1 time: 0.157686 Aug 19 21:23:43.652571 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 516/1108] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:23:43 2022] GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:23:43.672134 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-b1f0184a-ecbd-443f-89b3-9de45de8b17a tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:23:43.672736 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-b1f0184a-ecbd-443f-89b3-9de45de8b17a tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:23:43.679039 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b1f0184a-ecbd-443f-89b3-9de45de8b17a tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:43.679520 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b1f0184a-ecbd-443f-89b3-9de45de8b17a tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:43.679953 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b1f0184a-ecbd-443f-89b3-9de45de8b17a tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:43.680634 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b1f0184a-ecbd-443f-89b3-9de45de8b17a tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:43.681084 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b1f0184a-ecbd-443f-89b3-9de45de8b17a tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:43.681504 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-b1f0184a-ecbd-443f-89b3-9de45de8b17a tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:43.813189 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-b1f0184a-ecbd-443f-89b3-9de45de8b17a tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:23:43.821146 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-b1f0184a-ecbd-443f-89b3-9de45de8b17a tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 200 len: 1453 microversion: 2.1 time: 0.152905 Aug 19 21:23:43.821707 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 593/1109] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:23:43 2022] GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:23:45.425710 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-0ba8bcf9-d08b-4928-9265-a490e638e38d req-dc2f70ea-dcb6-4c1a-8cf4-1a5545e7c00a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a9b9c91-f09b-4454-b794-8f5da4a7046b", "tag": "69096231-9831-4016-a83c-1e4087e432ca"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:23:45.437087 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-0ba8bcf9-d08b-4928-9265-a490e638e38d req-dc2f70ea-dcb6-4c1a-8cf4-1a5545e7c00a service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:23:45.437656 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-0ba8bcf9-d08b-4928-9265-a490e638e38d req-dc2f70ea-dcb6-4c1a-8cf4-1a5545e7c00a service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:23:45.438188 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-0ba8bcf9-d08b-4928-9265-a490e638e38d req-dc2f70ea-dcb6-4c1a-8cf4-1a5545e7c00a service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:23:45.449623 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-0ba8bcf9-d08b-4928-9265-a490e638e38d req-dc2f70ea-dcb6-4c1a-8cf4-1a5545e7c00a service nova] Creating event network-changed:69096231-9831-4016-a83c-1e4087e432ca for instance 1a9b9c91-f09b-4454-b794-8f5da4a7046b on hv-cinder-85220 Aug 19 21:23:45.455928 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-0ba8bcf9-d08b-4928-9265-a490e638e38d req-dc2f70ea-dcb6-4c1a-8cf4-1a5545e7c00a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034028 Aug 19 21:23:45.456605 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 517/1110] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:25:17.221136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 21:25:17.221895 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Fri Aug 19 21:25:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 21:25:27.105683 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 21:25:27.106182 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Fri Aug 19 21:25:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 21:25:44.689934 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-c359e3a7-73e3-4f55-9646-b1702b275c06 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1013531528", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1136394165", "security_groups": [{"name": "tempest-secgroup-smoke-1474901084"}], "block_device_mapping_v2": [{"uuid": "b0b9b4ab-9216-4bdd-8e88-8d856b29aca6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "467ee159-81ce-42fd-8258-d5228258cf1c"}]}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:25:44.699394 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=34 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:25:44.700050 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=62 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:25:44.810498 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.network.neutron [None req-c359e3a7-73e3-4f55-9646-b1702b275c06 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] validate_networks() for [('467ee159-81ce-42fd-8258-d5228258cf1c', None, None, None, None, None)] {{(pid=120877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 21:25:45.232587 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-c359e3a7-73e3-4f55-9646-b1702b275c06 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Flavor limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 21:25:45.233003 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-c359e3a7-73e3-4f55-9646-b1702b275c06 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Image limits 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 21:25:45.233468 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-c359e3a7-73e3-4f55-9646-b1702b275c06 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Flavor pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 21:25:45.233910 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-c359e3a7-73e3-4f55-9646-b1702b275c06 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Image pref 0:0:0 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 21:25:45.234326 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.virt.hardware [None req-c359e3a7-73e3-4f55-9646-b1702b275c06 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 21:25:45.243990 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c359e3a7-73e3-4f55-9646-b1702b275c06 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:45.244462 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c359e3a7-73e3-4f55-9646-b1702b275c06 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:45.244891 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c359e3a7-73e3-4f55-9646-b1702b275c06 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:45.245644 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c359e3a7-73e3-4f55-9646-b1702b275c06 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:45.246125 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c359e3a7-73e3-4f55-9646-b1702b275c06 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:45.246539 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-c359e3a7-73e3-4f55-9646-b1702b275c06 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:45.263251 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-c359e3a7-73e3-4f55-9646-b1702b275c06 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Getting quotas for project b5c70daaa3b340a286f8f4ebe26b807d. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 21:25:45.267224 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.quota [None req-c359e3a7-73e3-4f55-9646-b1702b275c06 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Getting quotas for user d2749b3c8da94ce1b4af6c708a2f9db6 and project b5c70daaa3b340a286f8f4ebe26b807d. Resources: {'cores', 'ram', 'instances'} {{(pid=120877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 21:25:45.324173 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-c359e3a7-73e3-4f55-9646-b1702b275c06 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Going to run 1 instances... {{(pid=120877) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 21:25:45.326373 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-c359e3a7-73e3-4f55-9646-b1702b275c06 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 2138376d-c3b0-4c9d-b044-5e008cd78078] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b0b9b4ab-9216-4bdd-8e88-8d856b29aca6',volume_size=None,volume_type=None)] {{(pid=120877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 21:25:45.459405 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-c359e3a7-73e3-4f55-9646-b1702b275c06 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.774167 Aug 19 21:25:45.460028 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 594/1111] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Aug 19 21:25:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 21:25:45.470220 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR oslo.messaging._drivers.impl_rabbit [-] [71715ed4-b969-4a88-baa0-3063453bdc0c] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 19 21:25:45.471076 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:25:45.471821 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:25:45.476198 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-0b5934ab-8af6-44d5-b693-741ca08e50b2 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:25:45.476895 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-0b5934ab-8af6-44d5-b693-741ca08e50b2 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 2138376d-c3b0-4c9d-b044-5e008cd78078] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:25:45.540726 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-0b5934ab-8af6-44d5-b693-741ca08e50b2 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:25:45.548779 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-0b5934ab-8af6-44d5-b693-741ca08e50b2 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078" status: 200 len: 1095 microversion: 2.1 time: 0.081580 Aug 19 21:25:45.549367 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 518/1112] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:25:45 2022] GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078 => generated 1095 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:25:46.570778 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-21297d46-220a-4388-abd3-7c618a2aaaad tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:25:46.571406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-21297d46-220a-4388-abd3-7c618a2aaaad tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 2138376d-c3b0-4c9d-b044-5e008cd78078] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:25:46.577529 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-21297d46-220a-4388-abd3-7c618a2aaaad tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:46.578270 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-21297d46-220a-4388-abd3-7c618a2aaaad tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:46.578709 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-21297d46-220a-4388-abd3-7c618a2aaaad tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:46.579994 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-21297d46-220a-4388-abd3-7c618a2aaaad tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:46.580453 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-21297d46-220a-4388-abd3-7c618a2aaaad tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:46.580879 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-21297d46-220a-4388-abd3-7c618a2aaaad tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:46.662675 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-21297d46-220a-4388-abd3-7c618a2aaaad tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:25:46.670653 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-21297d46-220a-4388-abd3-7c618a2aaaad tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078" status: 200 len: 1211 microversion: 2.1 time: 0.104475 Aug 19 21:25:46.680300 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 595/1113] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:25:46 2022] GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078 => generated 1211 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:25:47.692396 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-307aafec-d596-4eda-8e21-82a7a1f7a3f7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:25:47.693004 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-307aafec-d596-4eda-8e21-82a7a1f7a3f7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 2138376d-c3b0-4c9d-b044-5e008cd78078] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:25:47.708628 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO oslo.messaging._drivers.impl_rabbit [-] [71715ed4-b969-4a88-baa0-3063453bdc0c] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 36086. Aug 19 21:25:47.711201 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-307aafec-d596-4eda-8e21-82a7a1f7a3f7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:47.711686 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-307aafec-d596-4eda-8e21-82a7a1f7a3f7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:47.712115 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-307aafec-d596-4eda-8e21-82a7a1f7a3f7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:47.712824 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-307aafec-d596-4eda-8e21-82a7a1f7a3f7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:47.713271 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-307aafec-d596-4eda-8e21-82a7a1f7a3f7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:47.713710 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-307aafec-d596-4eda-8e21-82a7a1f7a3f7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:47.929836 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-307aafec-d596-4eda-8e21-82a7a1f7a3f7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:25:47.938292 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-307aafec-d596-4eda-8e21-82a7a1f7a3f7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078" status: 200 len: 1267 microversion: 2.1 time: 0.250347 Aug 19 21:25:47.939347 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 519/1114] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:25:47 2022] GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078 => generated 1267 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:25:48.025058 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [req-7eda5472-ca6b-4d49-ad10-9d0e660cd982 req-8573e1d0-a745-4389-8611-1967b825a685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2138376d-c3b0-4c9d-b044-5e008cd78078", "tag": "17d6411b-500e-4033-b5d2-2bf263d8ccef"}]} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:25:48.035690 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-7eda5472-ca6b-4d49-ad10-9d0e660cd982 req-8573e1d0-a745-4389-8611-1967b825a685 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:48.036167 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-7eda5472-ca6b-4d49-ad10-9d0e660cd982 req-8573e1d0-a745-4389-8611-1967b825a685 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:48.036593 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [req-7eda5472-ca6b-4d49-ad10-9d0e660cd982 req-8573e1d0-a745-4389-8611-1967b825a685 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:48.048933 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.compute.server_external_events [req-7eda5472-ca6b-4d49-ad10-9d0e660cd982 req-8573e1d0-a745-4389-8611-1967b825a685 service nova] Creating event network-changed:17d6411b-500e-4033-b5d2-2bf263d8ccef for instance 2138376d-c3b0-4c9d-b044-5e008cd78078 on hv-cinder-85220 Aug 19 21:25:48.054071 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [req-7eda5472-ca6b-4d49-ad10-9d0e660cd982 req-8573e1d0-a745-4389-8611-1967b825a685 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112265 Aug 19 21:25:48.054854 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 596/1115] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 21:25:48.960018 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-c851f06d-c8e1-428e-bb41-ea68a785f93b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:25:48.960607 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-c851f06d-c8e1-428e-bb41-ea68a785f93b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 2138376d-c3b0-4c9d-b044-5e008cd78078] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:25:48.966993 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c851f06d-c8e1-428e-bb41-ea68a785f93b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:48.967471 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c851f06d-c8e1-428e-bb41-ea68a785f93b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:48.967900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c851f06d-c8e1-428e-bb41-ea68a785f93b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:48.968582 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c851f06d-c8e1-428e-bb41-ea68a785f93b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:48.969032 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c851f06d-c8e1-428e-bb41-ea68a785f93b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:48.970004 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-c851f06d-c8e1-428e-bb41-ea68a785f93b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:49.101953 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-c851f06d-c8e1-428e-bb41-ea68a785f93b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:25:49.109866 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-c851f06d-c8e1-428e-bb41-ea68a785f93b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078" status: 200 len: 1267 microversion: 2.1 time: 0.153703 Aug 19 21:25:49.110789 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 520/1116] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:25:48 2022] GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:25:50.132334 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-cc174a90-0e3a-4aeb-89da-8f4949bd1583 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:25:50.132960 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-cc174a90-0e3a-4aeb-89da-8f4949bd1583 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 2138376d-c3b0-4c9d-b044-5e008cd78078] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:25:50.139561 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cc174a90-0e3a-4aeb-89da-8f4949bd1583 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:50.140043 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cc174a90-0e3a-4aeb-89da-8f4949bd1583 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:50.140473 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cc174a90-0e3a-4aeb-89da-8f4949bd1583 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:50.141155 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cc174a90-0e3a-4aeb-89da-8f4949bd1583 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:50.142019 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cc174a90-0e3a-4aeb-89da-8f4949bd1583 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:50.142436 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-cc174a90-0e3a-4aeb-89da-8f4949bd1583 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:50.274442 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-cc174a90-0e3a-4aeb-89da-8f4949bd1583 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:25:50.283328 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-cc174a90-0e3a-4aeb-89da-8f4949bd1583 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078" status: 200 len: 1267 microversion: 2.1 time: 0.154445 Aug 19 21:25:50.283782 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 597/1117] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:25:50 2022] GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:25:51.304292 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-af796f32-5e0e-4307-8567-79c038fe3e6e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:25:51.304892 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-af796f32-5e0e-4307-8567-79c038fe3e6e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 2138376d-c3b0-4c9d-b044-5e008cd78078] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:25:51.311326 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-af796f32-5e0e-4307-8567-79c038fe3e6e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:51.311807 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-af796f32-5e0e-4307-8567-79c038fe3e6e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:51.312236 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-af796f32-5e0e-4307-8567-79c038fe3e6e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:51.312917 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-af796f32-5e0e-4307-8567-79c038fe3e6e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:51.313431 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-af796f32-5e0e-4307-8567-79c038fe3e6e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:51.314021 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-af796f32-5e0e-4307-8567-79c038fe3e6e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:51.447944 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-af796f32-5e0e-4307-8567-79c038fe3e6e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:25:51.455832 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-af796f32-5e0e-4307-8567-79c038fe3e6e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078" status: 200 len: 1267 microversion: 2.1 time: 0.155397 Aug 19 21:25:51.456420 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 521/1118] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:25:51 2022] GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:25:52.477054 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0309eb16-f0e2-4a06-bb45-9b4d09d0dba0 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:25:52.477659 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0309eb16-f0e2-4a06-bb45-9b4d09d0dba0 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 2138376d-c3b0-4c9d-b044-5e008cd78078] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:25:52.484235 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0309eb16-f0e2-4a06-bb45-9b4d09d0dba0 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:52.484721 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0309eb16-f0e2-4a06-bb45-9b4d09d0dba0 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:52.485930 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0309eb16-f0e2-4a06-bb45-9b4d09d0dba0 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:52.486657 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0309eb16-f0e2-4a06-bb45-9b4d09d0dba0 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:52.487112 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0309eb16-f0e2-4a06-bb45-9b4d09d0dba0 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:52.487537 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0309eb16-f0e2-4a06-bb45-9b4d09d0dba0 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:52.617755 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0309eb16-f0e2-4a06-bb45-9b4d09d0dba0 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:25:52.625348 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0309eb16-f0e2-4a06-bb45-9b4d09d0dba0 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078" status: 200 len: 1267 microversion: 2.1 time: 0.152194 Aug 19 21:25:52.626644 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 598/1119] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:25:52 2022] GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:25:53.647063 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-075d9869-935a-4e60-bb34-9360ab432d47 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:25:53.647695 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-075d9869-935a-4e60-bb34-9360ab432d47 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 2138376d-c3b0-4c9d-b044-5e008cd78078] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:25:53.654510 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-075d9869-935a-4e60-bb34-9360ab432d47 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:53.654989 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-075d9869-935a-4e60-bb34-9360ab432d47 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:53.655416 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-075d9869-935a-4e60-bb34-9360ab432d47 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:53.656095 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-075d9869-935a-4e60-bb34-9360ab432d47 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:53.656541 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-075d9869-935a-4e60-bb34-9360ab432d47 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:53.656963 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-075d9869-935a-4e60-bb34-9360ab432d47 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:53.793436 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-075d9869-935a-4e60-bb34-9360ab432d47 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:25:53.801807 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-075d9869-935a-4e60-bb34-9360ab432d47 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078" status: 200 len: 1267 microversion: 2.1 time: 0.158556 Aug 19 21:25:53.802378 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 522/1120] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:25:53 2022] GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:25:54.823555 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-9891f9f4-0c8f-45c3-8460-64724b84d528 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:25:54.824171 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-9891f9f4-0c8f-45c3-8460-64724b84d528 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 2138376d-c3b0-4c9d-b044-5e008cd78078] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:25:54.831113 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9891f9f4-0c8f-45c3-8460-64724b84d528 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:54.831600 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9891f9f4-0c8f-45c3-8460-64724b84d528 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:54.832039 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9891f9f4-0c8f-45c3-8460-64724b84d528 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:54.832731 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9891f9f4-0c8f-45c3-8460-64724b84d528 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:54.833185 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9891f9f4-0c8f-45c3-8460-64724b84d528 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:54.833610 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-9891f9f4-0c8f-45c3-8460-64724b84d528 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:54.964511 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-9891f9f4-0c8f-45c3-8460-64724b84d528 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:25:54.972984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-9891f9f4-0c8f-45c3-8460-64724b84d528 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078" status: 200 len: 1267 microversion: 2.1 time: 0.153291 Aug 19 21:25:54.973551 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 599/1121] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:25:54 2022] GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:25:55.998234 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-9a4d6d6b-78d6-4ec3-b7bf-220811e531f6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:25:55.998819 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-9a4d6d6b-78d6-4ec3-b7bf-220811e531f6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 2138376d-c3b0-4c9d-b044-5e008cd78078] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:25:56.002264 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell0:SELECT=2 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:25:56.007952 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9a4d6d6b-78d6-4ec3-b7bf-220811e531f6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:56.008432 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9a4d6d6b-78d6-4ec3-b7bf-220811e531f6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:56.008856 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9a4d6d6b-78d6-4ec3-b7bf-220811e531f6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:56.009540 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9a4d6d6b-78d6-4ec3-b7bf-220811e531f6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:56.010056 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9a4d6d6b-78d6-4ec3-b7bf-220811e531f6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:56.010533 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9a4d6d6b-78d6-4ec3-b7bf-220811e531f6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:56.141678 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9a4d6d6b-78d6-4ec3-b7bf-220811e531f6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:25:56.149979 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-9a4d6d6b-78d6-4ec3-b7bf-220811e531f6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078" status: 200 len: 1267 microversion: 2.1 time: 0.156415 Aug 19 21:25:56.150542 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 523/1122] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:25:55 2022] GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:25:57.171736 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-d3c8949e-7791-4e0a-b2c2-035b8225597f tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:25:57.172349 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-d3c8949e-7791-4e0a-b2c2-035b8225597f tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 2138376d-c3b0-4c9d-b044-5e008cd78078] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:25:57.174977 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=2 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:25:57.175625 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell0:SELECT=6 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:25:57.181827 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d3c8949e-7791-4e0a-b2c2-035b8225597f tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:57.182292 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d3c8949e-7791-4e0a-b2c2-035b8225597f tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:57.182725 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d3c8949e-7791-4e0a-b2c2-035b8225597f tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:57.183418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d3c8949e-7791-4e0a-b2c2-035b8225597f tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:57.183863 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d3c8949e-7791-4e0a-b2c2-035b8225597f tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:57.184280 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-d3c8949e-7791-4e0a-b2c2-035b8225597f tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:57.328927 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-d3c8949e-7791-4e0a-b2c2-035b8225597f tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:25:57.337642 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-d3c8949e-7791-4e0a-b2c2-035b8225597f tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078" status: 200 len: 1267 microversion: 2.1 time: 0.169760 Aug 19 21:25:57.338280 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 600/1123] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:25:57 2022] GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:25:58.359413 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-cc4bca41-11c2-4943-89c3-325cc88765d1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:25:58.360020 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-cc4bca41-11c2-4943-89c3-325cc88765d1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 2138376d-c3b0-4c9d-b044-5e008cd78078] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:25:58.366655 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cc4bca41-11c2-4943-89c3-325cc88765d1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:58.367040 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cc4bca41-11c2-4943-89c3-325cc88765d1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:58.367474 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cc4bca41-11c2-4943-89c3-325cc88765d1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:58.368161 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cc4bca41-11c2-4943-89c3-325cc88765d1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:58.368620 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cc4bca41-11c2-4943-89c3-325cc88765d1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:58.369041 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-cc4bca41-11c2-4943-89c3-325cc88765d1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:58.497960 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-cc4bca41-11c2-4943-89c3-325cc88765d1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:25:58.506458 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-cc4bca41-11c2-4943-89c3-325cc88765d1 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078" status: 200 len: 1267 microversion: 2.1 time: 0.150904 Aug 19 21:25:58.507021 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 524/1124] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:25:58 2022] GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:25:59.528488 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-5e94d0dc-27c5-4806-840e-17ca97a5da25 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:25:59.529095 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-5e94d0dc-27c5-4806-840e-17ca97a5da25 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 2138376d-c3b0-4c9d-b044-5e008cd78078] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:25:59.535765 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5e94d0dc-27c5-4806-840e-17ca97a5da25 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:59.536247 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5e94d0dc-27c5-4806-840e-17ca97a5da25 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:59.536681 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5e94d0dc-27c5-4806-840e-17ca97a5da25 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:59.537378 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5e94d0dc-27c5-4806-840e-17ca97a5da25 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:59.537854 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5e94d0dc-27c5-4806-840e-17ca97a5da25 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:59.538278 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5e94d0dc-27c5-4806-840e-17ca97a5da25 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:59.679525 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-5e94d0dc-27c5-4806-840e-17ca97a5da25 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:25:59.687373 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-5e94d0dc-27c5-4806-840e-17ca97a5da25 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078" status: 200 len: 1267 microversion: 2.1 time: 0.162929 Aug 19 21:25:59.687903 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 601/1125] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:25:59 2022] GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:25:59.841171 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-78f02590-5615-4e55-aae9-090293a9042a req-330f6bcd-8247-4914-9eba-0f2933f0a976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2138376d-c3b0-4c9d-b044-5e008cd78078", "name": "network-vif-plugged", "status": "completed", "tag": "17d6411b-500e-4033-b5d2-2bf263d8ccef"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:25:59.852889 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-78f02590-5615-4e55-aae9-090293a9042a req-330f6bcd-8247-4914-9eba-0f2933f0a976 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:25:59.853374 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-78f02590-5615-4e55-aae9-090293a9042a req-330f6bcd-8247-4914-9eba-0f2933f0a976 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:25:59.853828 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-78f02590-5615-4e55-aae9-090293a9042a req-330f6bcd-8247-4914-9eba-0f2933f0a976 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:25:59.864978 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-78f02590-5615-4e55-aae9-090293a9042a req-330f6bcd-8247-4914-9eba-0f2933f0a976 service nova] Creating event network-vif-plugged:17d6411b-500e-4033-b5d2-2bf263d8ccef for instance 2138376d-c3b0-4c9d-b044-5e008cd78078 on hv-cinder-85220 Aug 19 21:25:59.870440 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-78f02590-5615-4e55-aae9-090293a9042a req-330f6bcd-8247-4914-9eba-0f2933f0a976 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093615 Aug 19 21:25:59.871058 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 525/1126] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:26:00.708736 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-109b252b-c35d-4cab-af1a-fa35e14e6cd7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:26:00.709347 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-109b252b-c35d-4cab-af1a-fa35e14e6cd7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 2138376d-c3b0-4c9d-b044-5e008cd78078] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:26:00.715812 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-109b252b-c35d-4cab-af1a-fa35e14e6cd7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:26:00.716296 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-109b252b-c35d-4cab-af1a-fa35e14e6cd7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:26:00.716726 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-109b252b-c35d-4cab-af1a-fa35e14e6cd7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:26:00.717424 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-109b252b-c35d-4cab-af1a-fa35e14e6cd7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:26:00.717905 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-109b252b-c35d-4cab-af1a-fa35e14e6cd7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:26:00.718327 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-109b252b-c35d-4cab-af1a-fa35e14e6cd7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:26:00.858055 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-109b252b-c35d-4cab-af1a-fa35e14e6cd7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:26:00.866308 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-109b252b-c35d-4cab-af1a-fa35e14e6cd7 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078" status: 200 len: 1267 microversion: 2.1 time: 0.161630 Aug 19 21:26:00.866857 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 602/1127] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:26:00 2022] GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:26:01.888084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-d3b7c774-a318-4db5-9e60-4696d5798cc3 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:26:01.889322 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-d3b7c774-a318-4db5-9e60-4696d5798cc3 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 2138376d-c3b0-4c9d-b044-5e008cd78078] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:26:01.897061 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d3b7c774-a318-4db5-9e60-4696d5798cc3 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:26:01.897862 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d3b7c774-a318-4db5-9e60-4696d5798cc3 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:26:01.898307 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d3b7c774-a318-4db5-9e60-4696d5798cc3 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:26:01.899011 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d3b7c774-a318-4db5-9e60-4696d5798cc3 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:26:01.899727 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d3b7c774-a318-4db5-9e60-4696d5798cc3 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:26:01.900153 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-d3b7c774-a318-4db5-9e60-4696d5798cc3 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:26:02.037272 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-d3b7c774-a318-4db5-9e60-4696d5798cc3 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:26:02.045042 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-d3b7c774-a318-4db5-9e60-4696d5798cc3 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078" status: 200 len: 1455 microversion: 2.1 time: 0.161224 Aug 19 21:26:02.045605 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 526/1128] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:26:01 2022] GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078 => generated 1455 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 21:26:02.065873 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-a110ee6b-e3c7-4ebb-9f08-4a7529093d1f tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:26:02.066477 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-a110ee6b-e3c7-4ebb-9f08-4a7529093d1f tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 2138376d-c3b0-4c9d-b044-5e008cd78078] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:26:02.072906 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a110ee6b-e3c7-4ebb-9f08-4a7529093d1f tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:26:02.073385 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a110ee6b-e3c7-4ebb-9f08-4a7529093d1f tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:26:02.073837 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a110ee6b-e3c7-4ebb-9f08-4a7529093d1f tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:26:02.074520 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a110ee6b-e3c7-4ebb-9f08-4a7529093d1f tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:26:02.074969 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a110ee6b-e3c7-4ebb-9f08-4a7529093d1f tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:26:02.075387 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-a110ee6b-e3c7-4ebb-9f08-4a7529093d1f tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:26:02.210381 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-a110ee6b-e3c7-4ebb-9f08-4a7529093d1f tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:26:02.218140 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-a110ee6b-e3c7-4ebb-9f08-4a7529093d1f tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078" status: 200 len: 1455 microversion: 2.1 time: 0.156114 Aug 19 21:26:02.218705 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 603/1129] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:26:02 2022] GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078 => generated 1455 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:26:04.172084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-ef6fc295-dbba-4ae1-b02f-84d2899337fc req-e8cec5a6-acf2-4977-8a3d-8720f55e930d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2138376d-c3b0-4c9d-b044-5e008cd78078", "tag": "17d6411b-500e-4033-b5d2-2bf263d8ccef"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:26:04.182267 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-ef6fc295-dbba-4ae1-b02f-84d2899337fc req-e8cec5a6-acf2-4977-8a3d-8720f55e930d service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:26:04.182733 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-ef6fc295-dbba-4ae1-b02f-84d2899337fc req-e8cec5a6-acf2-4977-8a3d-8720f55e930d service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:26:04.183155 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-ef6fc295-dbba-4ae1-b02f-84d2899337fc req-e8cec5a6-acf2-4977-8a3d-8720f55e930d service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:26:04.194879 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-ef6fc295-dbba-4ae1-b02f-84d2899337fc req-e8cec5a6-acf2-4977-8a3d-8720f55e930d service nova] Creating event network-changed:17d6411b-500e-4033-b5d2-2bf263d8ccef for instance 2138376d-c3b0-4c9d-b044-5e008cd78078 on hv-cinder-85220 Aug 19 21:26:04.200084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-ef6fc295-dbba-4ae1-b02f-84d2899337fc req-e8cec5a6-acf2-4977-8a3d-8720f55e930d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031646 Aug 19 21:26:04.200707 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 527/1130] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:26:41.246658 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 21:26:41.247336 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Fri Aug 19 21:26:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 21:27:54.053896 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:27:54.054723 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG dbcounter [-] [120877] Writing DB stats nova_cell1:SELECT=52 {{(pid=120877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:27:54.059123 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-7470503b-6c9d-48fd-b3bb-a546de2cf48a tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:27:54.059296 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR oslo.messaging._drivers.impl_rabbit [-] [71715ed4-b969-4a88-baa0-3063453bdc0c] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 19 21:27:54.059705 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-7470503b-6c9d-48fd-b3bb-a546de2cf48a tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 2138376d-c3b0-4c9d-b044-5e008cd78078] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:27:54.059948 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_api:SELECT=22 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:27:54.061166 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG dbcounter [-] [120876] Writing DB stats nova_cell1:SELECT=46 {{(pid=120876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 21:27:54.068494 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7470503b-6c9d-48fd-b3bb-a546de2cf48a tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:27:54.069081 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7470503b-6c9d-48fd-b3bb-a546de2cf48a tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:27:54.069619 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7470503b-6c9d-48fd-b3bb-a546de2cf48a tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:27:54.070428 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7470503b-6c9d-48fd-b3bb-a546de2cf48a tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:27:54.070895 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7470503b-6c9d-48fd-b3bb-a546de2cf48a tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:27:54.071461 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-7470503b-6c9d-48fd-b3bb-a546de2cf48a tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:27:54.099853 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-7470503b-6c9d-48fd-b3bb-a546de2cf48a tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 2138376d-c3b0-4c9d-b044-5e008cd78078] Going to try to terminate instance {{(pid=120877) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 21:27:54.164177 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7470503b-6c9d-48fd-b3bb-a546de2cf48a tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [8dd80809-300c-4a34-955f-38187b775bf0] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 19 21:27:54.177648 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-23216e81-cab7-498c-9f07-593f32efd69a req-3a226b95-b262-4ca6-a81f-35700b8869b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2138376d-c3b0-4c9d-b044-5e008cd78078", "tag": "17d6411b-500e-4033-b5d2-2bf263d8ccef"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:27:54.187654 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-23216e81-cab7-498c-9f07-593f32efd69a req-3a226b95-b262-4ca6-a81f-35700b8869b0 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:27:54.188136 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-23216e81-cab7-498c-9f07-593f32efd69a req-3a226b95-b262-4ca6-a81f-35700b8869b0 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:27:54.188566 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-23216e81-cab7-498c-9f07-593f32efd69a req-3a226b95-b262-4ca6-a81f-35700b8869b0 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:27:54.200331 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-23216e81-cab7-498c-9f07-593f32efd69a req-3a226b95-b262-4ca6-a81f-35700b8869b0 service nova] Creating event network-changed:17d6411b-500e-4033-b5d2-2bf263d8ccef for instance 2138376d-c3b0-4c9d-b044-5e008cd78078 on hv-cinder-85220 Aug 19 21:27:54.205593 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-23216e81-cab7-498c-9f07-593f32efd69a req-3a226b95-b262-4ca6-a81f-35700b8869b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150914 Aug 19 21:27:54.207186 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 528/1131] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:27:55.171837 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO oslo.messaging._drivers.impl_rabbit [None req-7470503b-6c9d-48fd-b3bb-a546de2cf48a tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [8dd80809-300c-4a34-955f-38187b775bf0] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 36172. Aug 19 21:27:55.193099 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-7470503b-6c9d-48fd-b3bb-a546de2cf48a tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078" status: 204 len: 0 microversion: 2.1 time: 1.141375 Aug 19 21:27:55.193623 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 604/1132] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:27:54 2022] DELETE /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078 => generated 0 bytes in 1143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 21:27:55.202678 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-405f7174-da0f-4c54-b6dc-49435fefd0b6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:27:55.203381 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-405f7174-da0f-4c54-b6dc-49435fefd0b6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 2138376d-c3b0-4c9d-b044-5e008cd78078] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:27:55.213220 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-405f7174-da0f-4c54-b6dc-49435fefd0b6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:27:55.213677 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-405f7174-da0f-4c54-b6dc-49435fefd0b6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:27:55.214144 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-405f7174-da0f-4c54-b6dc-49435fefd0b6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:27:55.214874 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-405f7174-da0f-4c54-b6dc-49435fefd0b6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:27:55.215331 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-405f7174-da0f-4c54-b6dc-49435fefd0b6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:27:55.215750 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-405f7174-da0f-4c54-b6dc-49435fefd0b6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:27:55.221349 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO oslo.messaging._drivers.impl_rabbit [-] [71715ed4-b969-4a88-baa0-3063453bdc0c] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 36176. Aug 19 21:27:55.353701 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-405f7174-da0f-4c54-b6dc-49435fefd0b6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:27:55.361566 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-405f7174-da0f-4c54-b6dc-49435fefd0b6 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078" status: 200 len: 1461 microversion: 2.1 time: 0.163165 Aug 19 21:27:55.362182 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 529/1133] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:27:55 2022] GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078 => generated 1461 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:27:56.385420 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ef7004e4-3375-499e-bc21-7aed506ad17e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:27:56.386160 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-ef7004e4-3375-499e-bc21-7aed506ad17e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 2138376d-c3b0-4c9d-b044-5e008cd78078] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:27:56.393160 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ef7004e4-3375-499e-bc21-7aed506ad17e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:27:56.394305 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ef7004e4-3375-499e-bc21-7aed506ad17e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:27:56.394742 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ef7004e4-3375-499e-bc21-7aed506ad17e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:27:56.395428 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ef7004e4-3375-499e-bc21-7aed506ad17e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:27:56.396014 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ef7004e4-3375-499e-bc21-7aed506ad17e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:27:56.396285 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-ef7004e4-3375-499e-bc21-7aed506ad17e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:27:56.531558 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-ef7004e4-3375-499e-bc21-7aed506ad17e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:27:56.539753 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ef7004e4-3375-499e-bc21-7aed506ad17e tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078" status: 200 len: 1461 microversion: 2.1 time: 0.158498 Aug 19 21:27:56.540320 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 605/1134] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:27:56 2022] GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078 => generated 1461 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:27:57.349394 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-d5b1007a-9c26-4335-9e0e-e6561cb79147 req-643c68fe-10f2-4c41-b265-426a90926d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2138376d-c3b0-4c9d-b044-5e008cd78078", "name": "network-vif-deleted", "tag": "17d6411b-500e-4033-b5d2-2bf263d8ccef"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:27:57.360079 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-d5b1007a-9c26-4335-9e0e-e6561cb79147 req-643c68fe-10f2-4c41-b265-426a90926d69 service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:27:57.360586 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-d5b1007a-9c26-4335-9e0e-e6561cb79147 req-643c68fe-10f2-4c41-b265-426a90926d69 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:27:57.361017 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-d5b1007a-9c26-4335-9e0e-e6561cb79147 req-643c68fe-10f2-4c41-b265-426a90926d69 service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:27:57.374742 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-d5b1007a-9c26-4335-9e0e-e6561cb79147 req-643c68fe-10f2-4c41-b265-426a90926d69 service nova] Creating event network-vif-deleted:17d6411b-500e-4033-b5d2-2bf263d8ccef for instance 2138376d-c3b0-4c9d-b044-5e008cd78078 on hv-cinder-85220 Aug 19 21:27:57.381892 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-d5b1007a-9c26-4335-9e0e-e6561cb79147 req-643c68fe-10f2-4c41-b265-426a90926d69 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036339 Aug 19 21:27:57.382498 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 530/1135] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:27:57.562245 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-5488a6cf-6483-4651-9210-92a542ea53f2 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:27:57.562793 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-5488a6cf-6483-4651-9210-92a542ea53f2 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 2138376d-c3b0-4c9d-b044-5e008cd78078] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:27:57.569878 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5488a6cf-6483-4651-9210-92a542ea53f2 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:27:57.570369 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5488a6cf-6483-4651-9210-92a542ea53f2 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:27:57.570811 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5488a6cf-6483-4651-9210-92a542ea53f2 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:27:57.571506 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5488a6cf-6483-4651-9210-92a542ea53f2 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:27:57.571970 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5488a6cf-6483-4651-9210-92a542ea53f2 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:27:57.572395 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5488a6cf-6483-4651-9210-92a542ea53f2 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:27:57.639992 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-5488a6cf-6483-4651-9210-92a542ea53f2 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:27:57.648838 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-5488a6cf-6483-4651-9210-92a542ea53f2 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078" status: 200 len: 1226 microversion: 2.1 time: 0.090554 Aug 19 21:27:57.649418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 606/1136] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:27:57 2022] GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:27:58.671589 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-7aaaa76f-f05d-458d-a0fc-946bd03472ba tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:27:58.672203 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-7aaaa76f-f05d-458d-a0fc-946bd03472ba tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 2138376d-c3b0-4c9d-b044-5e008cd78078] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:27:58.679274 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7aaaa76f-f05d-458d-a0fc-946bd03472ba tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:27:58.679754 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7aaaa76f-f05d-458d-a0fc-946bd03472ba tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:27:58.680182 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7aaaa76f-f05d-458d-a0fc-946bd03472ba tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:27:58.680859 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7aaaa76f-f05d-458d-a0fc-946bd03472ba tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:27:58.681307 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7aaaa76f-f05d-458d-a0fc-946bd03472ba tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:27:58.681725 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-7aaaa76f-f05d-458d-a0fc-946bd03472ba tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:27:58.697310 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-7aaaa76f-f05d-458d-a0fc-946bd03472ba tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] HTTP exception thrown: Instance 2138376d-c3b0-4c9d-b044-5e008cd78078 could not be found. Aug 19 21:27:58.698957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-7aaaa76f-f05d-458d-a0fc-946bd03472ba tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Request method failure captured: Aug 19 21:27:58.698957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078 HTTP/1.1 Aug 19 21:27:58.698957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:27:58.698957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:27:58.698957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:27:58.698957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:27:58.698957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:27:58.698957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:27:58.698957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:27:58.698957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:27:58.698957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__5dJQ5Gcc7zHJnocFNrsoN6EnfMLReP5j1JpR1-_XK_2pQn5X2lqyTE8_DC917GQxE0DynYvBfXWw6hPfOmPGsZ9Job0Xos-VAbUnoy6UmBzAIF5HQ7QpROl1L8qKnaqTnE4vu89WHk3eVPqKw5KFO4L0U5lzhdWZ5ACJQ394XTCYQ Aug 19 21:27:58.698957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:27:58.698957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:27:58.698957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:27:58.698957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:27:58.698957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:27:58.698957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:27:58.698957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: b5c70daaa3b340a286f8f4ebe26b807d Aug 19 21:27:58.698957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-TestVolumeBootPattern-891379969 Aug 19 21:27:58.698957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:27:58.698957 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:27:58.700737 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b5c70daaa3b340a286f8f4ebe26b807d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b5c70daaa3b340a286f8f4ebe26b807d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b5c70daaa3b340a286f8f4ebe26b807d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b5c70daaa3b340a286f8f4ebe26b807d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:27:58.700737 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-TestVolumeBootPattern-891379969 Aug 19 21:27:58.700737 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: b5c70daaa3b340a286f8f4ebe26b807d Aug 19 21:27:58.700737 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-TestVolumeBootPattern-891379969 Aug 19 21:27:58.700737 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-TestVolumeBootPattern-891379969-project Aug 19 21:27:58.700737 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:27:58.700737 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:27:58.700737 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: d2749b3c8da94ce1b4af6c708a2f9db6 Aug 19 21:27:58.700737 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-TestVolumeBootPattern-891379969-project Aug 19 21:27:58.700737 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: > Aug 19 21:27:58.700737 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Instance 2138376d-c3b0-4c9d-b044-5e008cd78078 could not be found. Aug 19 21:27:58.700737 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': '2138376d-c3b0-4c9d-b044-5e008cd78078'} Aug 19 21:27:58.701757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:27:58.701757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:27:58.701757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:27:58.701757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:27:58.701757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:27:58.701757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:27:58.701757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:27:58.701757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:27:58.701757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:27:58.701757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:27:58.701757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2138376d-c3b0-4c9d-b044-5e008cd78078 could not be found. Aug 19 21:27:58.701757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:27:58.701757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:27:58.701757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:27:58.701757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:27:58.701757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:27:58.701757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:27:58.701757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:27:58.701757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:27:58.701757 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:27:58.703468 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:27:58.703468 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:27:58.703468 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:27:58.703468 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:27:58.703468 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:27:58.703468 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:27:58.703468 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:27:58.703468 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2138376d-c3b0-4c9d-b044-5e008cd78078 could not be found. Aug 19 21:27:58.703468 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:27:58.703468 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:27:58.703468 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:27:58.703468 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:27:58.703468 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:27:58.703468 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:27:58.703468 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:27:58.703468 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:27:58.703468 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2138376d-c3b0-4c9d-b044-5e008cd78078 could not be found. Aug 19 21:27:58.703468 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:27:58.705221 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-7aaaa76f-f05d-458d-a0fc-946bd03472ba tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Returning 404 to user: Instance 2138376d-c3b0-4c9d-b044-5e008cd78078 could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:27:58.705221 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-7aaaa76f-f05d-458d-a0fc-946bd03472ba tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078" status: 404 len: 111 microversion: 2.1 time: 0.033496 Aug 19 21:27:58.705221 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 531/1137] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:27:58 2022] GET /compute/v2.1/servers/2138376d-c3b0-4c9d-b044-5e008cd78078 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:28:01.771372 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-14f988c7-4022-4a71-8af3-fcbf4f9000a8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:28:01.771922 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-14f988c7-4022-4a71-8af3-fcbf4f9000a8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:28:01.778858 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-14f988c7-4022-4a71-8af3-fcbf4f9000a8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:28:01.779348 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-14f988c7-4022-4a71-8af3-fcbf4f9000a8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:28:01.779787 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-14f988c7-4022-4a71-8af3-fcbf4f9000a8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:28:01.779985 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-f946dde0-b603-4515-b24c-f6c19b371f32 req-1ec16b19-6fd5-4dd0-b69a-42d3d871451c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a9b9c91-f09b-4454-b794-8f5da4a7046b", "tag": "69096231-9831-4016-a83c-1e4087e432ca"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:28:01.780539 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-14f988c7-4022-4a71-8af3-fcbf4f9000a8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:28:01.781025 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-14f988c7-4022-4a71-8af3-fcbf4f9000a8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:28:01.781456 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-14f988c7-4022-4a71-8af3-fcbf4f9000a8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:28:01.790685 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-f946dde0-b603-4515-b24c-f6c19b371f32 req-1ec16b19-6fd5-4dd0-b69a-42d3d871451c service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:28:01.791215 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-f946dde0-b603-4515-b24c-f6c19b371f32 req-1ec16b19-6fd5-4dd0-b69a-42d3d871451c service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:28:01.791646 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-f946dde0-b603-4515-b24c-f6c19b371f32 req-1ec16b19-6fd5-4dd0-b69a-42d3d871451c service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:28:01.804112 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-f946dde0-b603-4515-b24c-f6c19b371f32 req-1ec16b19-6fd5-4dd0-b69a-42d3d871451c service nova] Creating event network-changed:69096231-9831-4016-a83c-1e4087e432ca for instance 1a9b9c91-f09b-4454-b794-8f5da4a7046b on hv-cinder-85220 Aug 19 21:28:01.809061 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-14f988c7-4022-4a71-8af3-fcbf4f9000a8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Going to try to terminate instance {{(pid=120877) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 21:28:01.809417 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-f946dde0-b603-4515-b24c-f6c19b371f32 req-1ec16b19-6fd5-4dd0-b69a-42d3d871451c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033108 Aug 19 21:28:01.810194 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 532/1138] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:28:01.910558 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-14f988c7-4022-4a71-8af3-fcbf4f9000a8 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 204 len: 0 microversion: 2.1 time: 0.142258 Aug 19 21:28:01.911576 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 607/1139] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:28:01 2022] DELETE /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 21:28:01.920482 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-9dc09e2c-760f-4812-8d56-367122ef198b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:28:01.921184 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-9dc09e2c-760f-4812-8d56-367122ef198b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:28:01.929577 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9dc09e2c-760f-4812-8d56-367122ef198b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:28:01.930093 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9dc09e2c-760f-4812-8d56-367122ef198b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:28:01.930524 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9dc09e2c-760f-4812-8d56-367122ef198b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:28:01.931216 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9dc09e2c-760f-4812-8d56-367122ef198b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:28:01.931852 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9dc09e2c-760f-4812-8d56-367122ef198b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:28:01.932271 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-9dc09e2c-760f-4812-8d56-367122ef198b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:28:02.092927 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.policy [None req-9dc09e2c-760f-4812-8d56-367122ef198b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120876) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:28:02.101138 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-9dc09e2c-760f-4812-8d56-367122ef198b tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 200 len: 1578 microversion: 2.1 time: 0.185041 Aug 19 21:28:02.101818 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 533/1140] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:28:01 2022] GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 1578 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:28:03.124002 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0854d059-0faf-4f87-a2bb-473a0e258d93 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:28:03.124903 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-0854d059-0faf-4f87-a2bb-473a0e258d93 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:28:03.132138 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0854d059-0faf-4f87-a2bb-473a0e258d93 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:28:03.132623 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0854d059-0faf-4f87-a2bb-473a0e258d93 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:28:03.133054 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0854d059-0faf-4f87-a2bb-473a0e258d93 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:28:03.133750 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0854d059-0faf-4f87-a2bb-473a0e258d93 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:28:03.134224 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0854d059-0faf-4f87-a2bb-473a0e258d93 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:28:03.134642 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-0854d059-0faf-4f87-a2bb-473a0e258d93 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:28:03.271720 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-0854d059-0faf-4f87-a2bb-473a0e258d93 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:28:03.279688 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0854d059-0faf-4f87-a2bb-473a0e258d93 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 200 len: 1578 microversion: 2.1 time: 0.160753 Aug 19 21:28:03.280244 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 608/1141] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:28:03 2022] GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:28:03.977754 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [req-1d6123db-0589-4b1b-9073-4647fed60af8 req-089cf408-6106-4c5a-8bf1-7bed9ce3f81c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a9b9c91-f09b-4454-b794-8f5da4a7046b", "name": "network-vif-deleted", "tag": "69096231-9831-4016-a83c-1e4087e432ca"}]} {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 21:28:03.990111 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-1d6123db-0589-4b1b-9073-4647fed60af8 req-089cf408-6106-4c5a-8bf1-7bed9ce3f81c service nova] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:28:03.990597 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-1d6123db-0589-4b1b-9073-4647fed60af8 req-089cf408-6106-4c5a-8bf1-7bed9ce3f81c service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:28:03.991088 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [req-1d6123db-0589-4b1b-9073-4647fed60af8 req-089cf408-6106-4c5a-8bf1-7bed9ce3f81c service nova] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:28:04.002869 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.compute.server_external_events [req-1d6123db-0589-4b1b-9073-4647fed60af8 req-089cf408-6106-4c5a-8bf1-7bed9ce3f81c service nova] Creating event network-vif-deleted:69096231-9831-4016-a83c-1e4087e432ca for instance 1a9b9c91-f09b-4454-b794-8f5da4a7046b on hv-cinder-85220 Aug 19 21:28:04.010920 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [req-1d6123db-0589-4b1b-9073-4647fed60af8 req-089cf408-6106-4c5a-8bf1-7bed9ce3f81c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036171 Aug 19 21:28:04.011704 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 534/1142] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Aug 19 21:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 21:28:04.302118 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e6945428-78a6-450e-b9f8-68b9b9df9036 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:28:04.302721 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-e6945428-78a6-450e-b9f8-68b9b9df9036 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:28:04.312699 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e6945428-78a6-450e-b9f8-68b9b9df9036 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:28:04.313209 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e6945428-78a6-450e-b9f8-68b9b9df9036 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:28:04.313650 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e6945428-78a6-450e-b9f8-68b9b9df9036 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:28:04.314426 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e6945428-78a6-450e-b9f8-68b9b9df9036 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:28:04.314880 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e6945428-78a6-450e-b9f8-68b9b9df9036 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:28:04.316173 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-e6945428-78a6-450e-b9f8-68b9b9df9036 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:28:04.390194 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.policy [None req-e6945428-78a6-450e-b9f8-68b9b9df9036 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2749b3c8da94ce1b4af6c708a2f9db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c70daaa3b340a286f8f4ebe26b807d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120877) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 21:28:04.398552 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e6945428-78a6-450e-b9f8-68b9b9df9036 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 200 len: 1225 microversion: 2.1 time: 0.101123 Aug 19 21:28:04.403530 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 609/1143] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:28:04 2022] GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 21:28:05.421355 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-611241f3-492d-4ec1-b25f-8e1a08746c90 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:28:05.422026 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-611241f3-492d-4ec1-b25f-8e1a08746c90 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 1a9b9c91-f09b-4454-b794-8f5da4a7046b] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:28:05.428789 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-611241f3-492d-4ec1-b25f-8e1a08746c90 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:28:05.429271 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-611241f3-492d-4ec1-b25f-8e1a08746c90 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:28:05.429703 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-611241f3-492d-4ec1-b25f-8e1a08746c90 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:28:05.430431 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-611241f3-492d-4ec1-b25f-8e1a08746c90 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:28:05.430886 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-611241f3-492d-4ec1-b25f-8e1a08746c90 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:28:05.431324 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-611241f3-492d-4ec1-b25f-8e1a08746c90 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:28:05.445258 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-611241f3-492d-4ec1-b25f-8e1a08746c90 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] HTTP exception thrown: Instance 1a9b9c91-f09b-4454-b794-8f5da4a7046b could not be found. Aug 19 21:28:05.446900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-611241f3-492d-4ec1-b25f-8e1a08746c90 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Request method failure captured: Aug 19 21:28:05.446900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b HTTP/1.1 Aug 19 21:28:05.446900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:28:05.446900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:28:05.446900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:28:05.446900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:28:05.446900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:28:05.446900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:28:05.446900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:28:05.446900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:28:05.446900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__5dJQ5Gcc7zHJnocFNrsoN6EnfMLReP5j1JpR1-_XK_2pQn5X2lqyTE8_DC917GQxE0DynYvBfXWw6hPfOmPGsZ9Job0Xos-VAbUnoy6UmBzAIF5HQ7QpROl1L8qKnaqTnE4vu89WHk3eVPqKw5KFO4L0U5lzhdWZ5ACJQ394XTCYQ Aug 19 21:28:05.446900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:28:05.446900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:28:05.446900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:28:05.446900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:28:05.446900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:28:05.446900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:28:05.446900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: b5c70daaa3b340a286f8f4ebe26b807d Aug 19 21:28:05.446900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-TestVolumeBootPattern-891379969 Aug 19 21:28:05.446900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:28:05.446900 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:28:05.448581 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b5c70daaa3b340a286f8f4ebe26b807d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b5c70daaa3b340a286f8f4ebe26b807d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b5c70daaa3b340a286f8f4ebe26b807d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b5c70daaa3b340a286f8f4ebe26b807d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:28:05.448581 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-TestVolumeBootPattern-891379969 Aug 19 21:28:05.448581 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: b5c70daaa3b340a286f8f4ebe26b807d Aug 19 21:28:05.448581 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-TestVolumeBootPattern-891379969 Aug 19 21:28:05.448581 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-TestVolumeBootPattern-891379969-project Aug 19 21:28:05.448581 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:28:05.448581 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:28:05.448581 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: d2749b3c8da94ce1b4af6c708a2f9db6 Aug 19 21:28:05.448581 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-TestVolumeBootPattern-891379969-project Aug 19 21:28:05.448581 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: > Aug 19 21:28:05.448581 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Instance 1a9b9c91-f09b-4454-b794-8f5da4a7046b could not be found. Aug 19 21:28:05.448581 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': '1a9b9c91-f09b-4454-b794-8f5da4a7046b'} Aug 19 21:28:05.449674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:28:05.449674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:28:05.449674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:28:05.449674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:28:05.449674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:28:05.449674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:28:05.449674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:28:05.449674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:28:05.449674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:28:05.449674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:28:05.449674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a9b9c91-f09b-4454-b794-8f5da4a7046b could not be found. Aug 19 21:28:05.449674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:28:05.449674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:28:05.449674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:28:05.449674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:28:05.449674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:28:05.449674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:28:05.449674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:28:05.449674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:28:05.449674 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:28:05.451300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:28:05.451300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:28:05.451300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:28:05.451300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:28:05.451300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:28:05.451300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:28:05.451300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:28:05.451300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a9b9c91-f09b-4454-b794-8f5da4a7046b could not be found. Aug 19 21:28:05.451300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:28:05.451300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:28:05.451300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:28:05.451300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:28:05.451300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:28:05.451300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:28:05.451300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:28:05.451300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:28:05.451300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a9b9c91-f09b-4454-b794-8f5da4a7046b could not be found. Aug 19 21:28:05.451300 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:28:05.452789 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-611241f3-492d-4ec1-b25f-8e1a08746c90 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Returning 404 to user: Instance 1a9b9c91-f09b-4454-b794-8f5da4a7046b could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:28:05.452789 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-611241f3-492d-4ec1-b25f-8e1a08746c90 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b" status: 404 len: 111 microversion: 2.1 time: 0.031971 Aug 19 21:28:05.452789 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 535/1144] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:28:05 2022] GET /compute/v2.1/servers/1a9b9c91-f09b-4454-b794-8f5da4a7046b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:28:05.917424 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8cb817e0-3f0a-4ed1-96da-dd00c0521112 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:28:05.917984 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.compute.api [None req-8cb817e0-3f0a-4ed1-96da-dd00c0521112 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120877) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:28:05.924337 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8cb817e0-3f0a-4ed1-96da-dd00c0521112 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:28:05.924815 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8cb817e0-3f0a-4ed1-96da-dd00c0521112 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:28:05.925251 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8cb817e0-3f0a-4ed1-96da-dd00c0521112 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:28:05.925968 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8cb817e0-3f0a-4ed1-96da-dd00c0521112 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:28:05.926424 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8cb817e0-3f0a-4ed1-96da-dd00c0521112 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:28:05.926850 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-8cb817e0-3f0a-4ed1-96da-dd00c0521112 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:28:05.940240 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-8cb817e0-3f0a-4ed1-96da-dd00c0521112 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] HTTP exception thrown: Instance 67d0593a-5bf1-4f0d-94ac-89589766e987 could not be found. Aug 19 21:28:05.942418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8cb817e0-3f0a-4ed1-96da-dd00c0521112 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Request method failure captured: Aug 19 21:28:05.942418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: request: DELETE /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 HTTP/1.1 Aug 19 21:28:05.942418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept: application/json Aug 19 21:28:05.942418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Accept-Encoding: identity Aug 19 21:28:05.942418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Connection: close Aug 19 21:28:05.942418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Length: 0 Aug 19 21:28:05.942418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Content-Type: application/json Aug 19 21:28:05.942418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Host: 10.222.0.16 Aug 19 21:28:05.942418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Openstack-System-Scope: None Aug 19 21:28:05.942418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: User-Agent: python-urllib3/1.26.11 Aug 19 21:28:05.942418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Auth-Token: gAAAAABi__5dJQ5Gcc7zHJnocFNrsoN6EnfMLReP5j1JpR1-_XK_2pQn5X2lqyTE8_DC917GQxE0DynYvBfXWw6hPfOmPGsZ9Job0Xos-VAbUnoy6UmBzAIF5HQ7QpROl1L8qKnaqTnE4vu89WHk3eVPqKw5KFO4L0U5lzhdWZ5ACJQ394XTCYQ Aug 19 21:28:05.942418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Id: None Aug 19 21:28:05.942418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Domain-Name: None Aug 19 21:28:05.942418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Identity-Status: Confirmed Aug 19 21:28:05.942418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Is-Admin-Project: True Aug 19 21:28:05.942418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Id: default Aug 19 21:28:05.942418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Domain-Name: Default Aug 19 21:28:05.942418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Id: b5c70daaa3b340a286f8f4ebe26b807d Aug 19 21:28:05.942418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Project-Name: tempest-TestVolumeBootPattern-891379969 Aug 19 21:28:05.942418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Role: member,reader Aug 19 21:28:05.942418 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Roles: member,reader Aug 19 21:28:05.944293 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b5c70daaa3b340a286f8f4ebe26b807d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b5c70daaa3b340a286f8f4ebe26b807d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b5c70daaa3b340a286f8f4ebe26b807d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b5c70daaa3b340a286f8f4ebe26b807d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:28:05.944293 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant: tempest-TestVolumeBootPattern-891379969 Aug 19 21:28:05.944293 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Id: b5c70daaa3b340a286f8f4ebe26b807d Aug 19 21:28:05.944293 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-Tenant-Name: tempest-TestVolumeBootPattern-891379969 Aug 19 21:28:05.944293 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User: tempest-TestVolumeBootPattern-891379969-project Aug 19 21:28:05.944293 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Id: default Aug 19 21:28:05.944293 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Domain-Name: Default Aug 19 21:28:05.944293 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Id: d2749b3c8da94ce1b4af6c708a2f9db6 Aug 19 21:28:05.944293 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: X-User-Name: tempest-TestVolumeBootPattern-891379969-project Aug 19 21:28:05.944293 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: method: > Aug 19 21:28:05.944293 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: exception: Instance 67d0593a-5bf1-4f0d-94ac-89589766e987 could not be found. Aug 19 21:28:05.944293 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: action_args: {'id': '67d0593a-5bf1-4f0d-94ac-89589766e987'} Aug 19 21:28:05.945406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:28:05.945406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:28:05.945406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:28:05.945406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:28:05.945406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:28:05.945406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:28:05.945406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:28:05.945406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:28:05.945406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:28:05.945406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:28:05.945406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67d0593a-5bf1-4f0d-94ac-89589766e987 could not be found. Aug 19 21:28:05.945406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:28:05.945406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:28:05.945406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:28:05.945406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:28:05.945406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:28:05.945406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:28:05.945406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:28:05.945406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:28:05.945406 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:28:05.947047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:28:05.947047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 21:28:05.947047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 21:28:05.947047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 21:28:05.947047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 21:28:05.947047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:28:05.947047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:28:05.947047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:28:05.947047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:28:05.947047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67d0593a-5bf1-4f0d-94ac-89589766e987 could not be found. Aug 19 21:28:05.947047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:28:05.947047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:28:05.947047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:28:05.947047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:28:05.947047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:28:05.947047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:28:05.947047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:28:05.947047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:28:05.947047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67d0593a-5bf1-4f0d-94ac-89589766e987 could not be found. Aug 19 21:28:05.947047 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: ERROR nova.api.openstack.wsgi Aug 19 21:28:05.948806 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8cb817e0-3f0a-4ed1-96da-dd00c0521112 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Returning 404 to user: Instance 67d0593a-5bf1-4f0d-94ac-89589766e987 could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:28:05.948806 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8cb817e0-3f0a-4ed1-96da-dd00c0521112 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "DELETE /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 404 len: 111 microversion: 2.1 time: 0.030419 Aug 19 21:28:05.948806 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 610/1145] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Aug 19 21:28:05 2022] DELETE /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:28:05.952692 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-93bbf7bf-d231-4570-82c4-328c2cdf099c tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '>' {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:28:05.953470 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.compute.api [None req-93bbf7bf-d231-4570-82c4-328c2cdf099c tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] [instance: 67d0593a-5bf1-4f0d-94ac-89589766e987] Fetching instance by UUID {{(pid=120876) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 21:28:05.960075 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-93bbf7bf-d231-4570-82c4-328c2cdf099c tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:28:05.960553 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-93bbf7bf-d231-4570-82c4-328c2cdf099c tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:28:05.960979 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-93bbf7bf-d231-4570-82c4-328c2cdf099c tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:28:05.961656 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-93bbf7bf-d231-4570-82c4-328c2cdf099c tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Acquiring lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 21:28:05.962129 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-93bbf7bf-d231-4570-82c4-328c2cdf099c tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 21:28:05.962544 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG oslo_concurrency.lockutils [None req-93bbf7bf-d231-4570-82c4-328c2cdf099c tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Lock "fc0b118c-f5c7-41ee-a2c7-c718014c8ac6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 21:28:05.975951 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.wsgi [None req-93bbf7bf-d231-4570-82c4-328c2cdf099c tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] HTTP exception thrown: Instance 67d0593a-5bf1-4f0d-94ac-89589766e987 could not be found. Aug 19 21:28:05.977463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-93bbf7bf-d231-4570-82c4-328c2cdf099c tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Request method failure captured: Aug 19 21:28:05.977463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: request: GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 HTTP/1.1 Aug 19 21:28:05.977463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept: application/json Aug 19 21:28:05.977463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Accept-Encoding: identity Aug 19 21:28:05.977463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Connection: close Aug 19 21:28:05.977463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Length: 0 Aug 19 21:28:05.977463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Content-Type: application/json Aug 19 21:28:05.977463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Host: 10.222.0.16 Aug 19 21:28:05.977463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Openstack-System-Scope: None Aug 19 21:28:05.977463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: User-Agent: python-urllib3/1.26.11 Aug 19 21:28:05.977463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Auth-Token: gAAAAABi__5dJQ5Gcc7zHJnocFNrsoN6EnfMLReP5j1JpR1-_XK_2pQn5X2lqyTE8_DC917GQxE0DynYvBfXWw6hPfOmPGsZ9Job0Xos-VAbUnoy6UmBzAIF5HQ7QpROl1L8qKnaqTnE4vu89WHk3eVPqKw5KFO4L0U5lzhdWZ5ACJQ394XTCYQ Aug 19 21:28:05.977463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Id: None Aug 19 21:28:05.977463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Domain-Name: None Aug 19 21:28:05.977463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Identity-Status: Confirmed Aug 19 21:28:05.977463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Is-Admin-Project: True Aug 19 21:28:05.977463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Id: default Aug 19 21:28:05.977463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Domain-Name: Default Aug 19 21:28:05.977463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Id: b5c70daaa3b340a286f8f4ebe26b807d Aug 19 21:28:05.977463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Project-Name: tempest-TestVolumeBootPattern-891379969 Aug 19 21:28:05.977463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Role: member,reader Aug 19 21:28:05.977463 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Roles: member,reader Aug 19 21:28:05.979304 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b5c70daaa3b340a286f8f4ebe26b807d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b5c70daaa3b340a286f8f4ebe26b807d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b5c70daaa3b340a286f8f4ebe26b807d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b5c70daaa3b340a286f8f4ebe26b807d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 19 21:28:05.979304 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant: tempest-TestVolumeBootPattern-891379969 Aug 19 21:28:05.979304 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Id: b5c70daaa3b340a286f8f4ebe26b807d Aug 19 21:28:05.979304 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-Tenant-Name: tempest-TestVolumeBootPattern-891379969 Aug 19 21:28:05.979304 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User: tempest-TestVolumeBootPattern-891379969-project Aug 19 21:28:05.979304 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Id: default Aug 19 21:28:05.979304 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Domain-Name: Default Aug 19 21:28:05.979304 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Id: d2749b3c8da94ce1b4af6c708a2f9db6 Aug 19 21:28:05.979304 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: X-User-Name: tempest-TestVolumeBootPattern-891379969-project Aug 19 21:28:05.979304 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: method: > Aug 19 21:28:05.979304 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: exception: Instance 67d0593a-5bf1-4f0d-94ac-89589766e987 could not be found. Aug 19 21:28:05.979304 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: action_args: {'id': '67d0593a-5bf1-4f0d-94ac-89589766e987'} Aug 19 21:28:05.983473 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: {{(pid=120876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 21:28:05.983473 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:28:05.983473 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 21:28:05.983473 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 21:28:05.983473 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 21:28:05.983473 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 21:28:05.983473 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 21:28:05.983473 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 21:28:05.983473 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 21:28:05.983473 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 21:28:05.983473 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67d0593a-5bf1-4f0d-94ac-89589766e987 could not be found. Aug 19 21:28:05.983473 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:28:05.983473 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:28:05.983473 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:28:05.983473 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:28:05.983473 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:28:05.983473 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:28:05.983473 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 21:28:05.983473 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 21:28:05.983473 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 21:28:05.985084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 21:28:05.985084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 21:28:05.985084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 21:28:05.985084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 21:28:05.985084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 21:28:05.985084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 21:28:05.985084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 21:28:05.985084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67d0593a-5bf1-4f0d-94ac-89589766e987 could not be found. Aug 19 21:28:05.985084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:28:05.985084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 21:28:05.985084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:28:05.985084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 21:28:05.985084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 21:28:05.985084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 21:28:05.985084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 21:28:05.985084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 21:28:05.985084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67d0593a-5bf1-4f0d-94ac-89589766e987 could not be found. Aug 19 21:28:05.985084 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: ERROR nova.api.openstack.wsgi Aug 19 21:28:05.987011 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: DEBUG nova.api.openstack.wsgi [None req-93bbf7bf-d231-4570-82c4-328c2cdf099c tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Returning 404 to user: Instance 67d0593a-5bf1-4f0d-94ac-89589766e987 could not be found. {{(pid=120876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 21:28:05.987011 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO nova.api.openstack.requestlog [None req-93bbf7bf-d231-4570-82c4-328c2cdf099c tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987" status: 404 len: 111 microversion: 2.1 time: 0.029999 Aug 19 21:28:05.987011 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: [pid: 120876|app: 0|req: 536/1146] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Aug 19 21:28:05 2022] GET /compute/v2.1/servers/67d0593a-5bf1-4f0d-94ac-89589766e987 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 21:28:07.280399 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-1b46af81-171f-4b52-a381-f2bc5c4e36b0 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] Calling method '.version_select at 0x7f740bdbcee0>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 21:28:07.308760 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-1b46af81-171f-4b52-a381-f2bc5c4e36b0 tempest-TestVolumeBootPattern-891379969 tempest-TestVolumeBootPattern-891379969-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1136394165" status: 202 len: 0 microversion: 2.1 time: 0.032509 Aug 19 21:28:07.309428 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 611/1147] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Aug 19 21:28:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1136394165 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 21:28:27.203551 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 21:28:27.204214 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Fri Aug 19 21:28:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 21:28:37.231021 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 21:28:37.231587 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Fri Aug 19 21:28:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 21:30:01.256045 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 21:30:01.256676 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Fri Aug 19 21:30:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 21:30:27.115782 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 21:30:27.116389 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Fri Aug 19 21:30:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 21:31:47.211568 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 21:31:47.212152 dv-cinder-852209-6-iscsi devstack@n-api.service[120877]: Fri Aug 19 21:31:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 21:31:57.240407 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 21:31:57.241005 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Fri Aug 19 21:31:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 21:33:21.265109 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 21:33:21.266182 dv-cinder-852209-6-iscsi devstack@n-api.service[120876]: Fri Aug 19 21:33:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!